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Brief Reports 


The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 
first or second issue to go to press following 
their final acceptance. 


An author who wishes to submit a Brief 
Report: 


1. Sends the Brief Report, limited to one printed 
page and prepared according to the specifications 
given below. 

2. Also sends to the Editor a full report of the re- 
search study, in sufficient detail to give a clear ac- 
count of its background, procedure, results, and con- 
clusions, which will be filed with the American 
Documentation Institute to insure indefinite avail- 
ability. 

3. Prepares at least 100 mimeographed copies of 
the full report, which the author will send without 
charge to all who request it as long as the supply 
lasts. 

4. Agrees not to submit the full report to another 
journal of general circulation. 


Specifications 


Brief Report. The Brief Report should give 
a clear, condensed summary of the procedure 
of the study and as full an account of the re- 
sults as space permits. 

To insure that the Brief Report will be no 
longer than one printed page, its typescript, 


including all matter except the title and the 
author’s lines, must not exceed 85 lines av- 
eraging 42 characters and spaces in length. 
Set the typewriter margins for short lines of 
42 characters, which are 3.5 inches long in 
elite typing, and 4.2 inches long in pica. 

The manuscript of the Brief Report must 
be double spaced throughout. Except for its 
short lines, it follows the standard style of 
the 1957 revision of the APA Publication 
Manual. Headings, tables, and references are 
avoided or, if essential, must be counted in 
the 85 lines. Each Brief Report must be ac- 
companied by a footnote in the style below, 
which is typed on a separate sheet and not 
counted in the 85-line quota: ' 


1An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. (giving the author’s full name 
and address), or for a fee from the American Docu- 
mentation Institute. Order Document No. , Te- 
mitting $—— for microfilm or $—— 
copies. 


for photo- 


Extended report. Because the extended re- 
port is intended for photoduplication, and is 
not copy to be sent to a printer, its style 
should differ in several ways from that of 
other manuscripts: (a) The extended report 
should be typed with single spacing for 
economy in duplication. (6) Tables and fig- 
ures should be placed adjacent to the text 
which refers to them. A caption should be 
typed below each figure. (c) Footnotes should 
be typed at the bottom of the page on which 
reference is made to them. In other respects, 
the full report is prepared in the style speci- 
fied by the Publication Manual. 
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ON THE BREAKDOWN OF THE SENSE OF REALITY: 
A STUDY OF SPATIAL PERCEPTION IN SCHIZOPHRENIA 


ANN HOZIER 
Topeka State Hospital, Kansa 


The breakdown of the sense of reality in 
human functioning has been viewed clinically 
as an essential feature of abnormal behavior. 
So central is the importance of the loss of re- 
ality contact in diagnosing mental illness, that 
the severity and the depth of this illness has 
been measured clinically by the severity and 
extensiveness of this loss of reality contact. 
Freud (1953c, 1953d), when he attempts to 
extend his psychoanalytic views to the total 
field of mental deviations, chooses to distin- 
guish neurotic from psychotic behavior by 
this central factor of reality relationship. 
“Neurosis does not deny the existence of re- 
ality, it merely tries to ignore it; psychosis 
denies it and tries to substitute something 
else for it” (Freud, 1953c, p. 279). 

Clearly, this loss of reality contact is not 
the only symptom of mental illness. Yet, be- 
cause it extends to all aspects of human func- 
tioning, it is safe to say that it is of para- 
mount importance in determining and circum- 
scribing psychotic behavior. In this sense, 
then, to search for the causes of a breakdown 
of the sense of reality becomes practically a 
search for the causes of psychotic breakdowns. 

For years, clinicians have been using evi- 
dences of disturbance in spatial perception as 
one of the manifestations of the loss of re- 
ality contact. The psychiatric examination in- 
cludes such questions as “Who are you?” and 
“Where are you?” Confusion with regard to 

1 This study is part of a dissertation submitted in 
partial fulfillment of the requirements for the degree 
of doctor of philosophy to the Graduate School of 
the University of Kansas. The author wishes to ex- 
press gratitude to Austin M. Des Lauriers for allow- 
ing her the opportunity of exploring with him some 
of the implications of his theoretical ideas 

2 Now at Mendota State Hospital, Madison, Wis 
consin 


orientation to person and place is considered 
an indication of reality severance. Yet, the 
intimate relationship between confusion about 
oneself, the loss or disturbance of one’s ori- 
entation in space, and the breakdown of the 
sense of reality has received, with few excep- 
tions, little exploration. 

Des Lauriers (1955, 1956), in an extensive 
study on the breakdown of the sense of re 
ality in schizophrenic children, offers a sys 
tematic set of hypotheses concerning the es- 
sential conditions for ‘the development of 
stable reality relationships. His approach 
touches upon the intrinsic or structural as 
pects of the breakdown of the sense of re 
ality. It is less concerned with what, exter 
nally, might bring about the breakdown 
(family conflicts, organic brain pathology, 
heredity, congenital defects, etc.) than with 
what, internally, it involves. 

The Des Lauriers hypotheses are developed 
in the context of the psychoanalytic theory of 
the ego (Federn, 1952; Freud: 1927, 
Hartmann, 1957; Hartmann & Lowenstein, 
1948; Rapaport, 1954). Des Lauriers hy 
pothesizes that the primary model of reality 
in the psychological experience of the indi 
vidual, is the awareness of one’s bodily self 
as bounded, finite, separated, and differenti 
ated from everything that is not the self. The 
establishment of the bodily self is hypothe 
sized by Des Lauriers to be intimately re 
lated to the amount of affective cathexis of 
the body. 

The present study was designed to test, in 
part, the validity of Des Lauriers’ theory, by 
investigating experimentally one of its logi- 
cal consequences and extensions. The problem 
which was chosen concerned the perception of 
spatial relationships by the schizophrenic in 
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dividual, as it is directly related to the prob- 
lem of the bodily self. 

If we assume, as Des Lauriers does, that 
the psychological model of reality is the ex- 
perience of one’s bodily self as differentiated, 
bounded, and separated from everything that 
is not the self, then we may hypothesize that 
the loss of the sense of reality in the schizo- 
phrenic individual involves a breakdown in 
the bodily self as a consequence of insuffi- 
cient cathexis of the body. This does not mean 
that the schizophrenic individual does not 
have affective cathexis available to him. He 
does, but he is not using it in cathecting his 
body. As long as the body is not sufficiently 
cathected to become bounded and differenti- 
ated from everything that is not the body, 
there exists no frame of reference from which 
to judge the reality of events in the external 
world or the reality of one’s own psychologi- 
cal experiences. Consequently, as long as the 
self/nonself differentiation does not exist, all 
types of problems involved in the separation 
of self from nonself will be in some way af- 
fected, and among these problems is the prob 
lem of spatial relations and organization. 


Methods and Procedures 
Subjects 

The Ss were 25 schizophrenic women pa- 
tients at Topeka State Hospital. The control 
group consisted of 25 women, eight of whom 
were employed by the hospital, two as psy- 
chiatric aides, and six as secretaries. The re- 
maining women were housewives. 

The selection criteria for the schizophrenics 
were: (a) an established psychiatric diagnosis 
of schizophrenia of at least two years’ dura- 
tion; (6) under the age of 60; (c) no evi 
dence of neurological involvement or mental 
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deficiency; (d) not under treatment with 
insulin coma or electric shock therapy; and 
(e) cooperative as judged by their ward psy- 
chiatrist and the investigator. 

The selection criteria for the controls were: 
(a) at the present time not hospitalized in a 
psychiatric hospital; (5) under the age of 60; 
and (c) no implication of neurological in- 
volvement or mental deficiency. All of the 
control Ss volunteered to participate in the 
experiment. 

The raw score of the Vocabulary subtest of 
the Wechsler-Bellevue, Form I, was used as 
an estimate of intelligence. A comparison of 
the control and schizophrenic groups on the 
variables of age, education, and intelligence is 
presented in Table 1. The F test for homo- 
geneity of variance with the appropriate ¢ 
test as recommended by Edwards (1950) was 
used to evaluate the difference between the 
means of the groups. None of the means were 
significantly different. 

The duration of illness, which was defined 
as the amount of time elapsed between the 
first diagnosed schizophrenic breakdown and 
the time of the study, ranged from 2 to 28 
years, with a mean of 10.41 and a standard 
of 4.15. The first schizophrenic 
breakdown in our population, then, occurred 
on the average in the early thirties. There 
were eight patients each of the paranoid and 
undifferentiated type; four the 
catatonic type; and one each of the hebe- 
phrenic, simple, mixed, affective, and acute 
undifferentiated type. The acuteness or chro- 
nicity of their symptomatology varied. Some 
of the patients needed maximum supervision, 


deviation 


chronic of 


others minimum, and a few were in the proc- 
ess of obtaining positions outside of the hos- 
pital 


Table 


Comparison of the Control and Schizophreni 


Group 


41.60 
43.40 


20.10 
16.45 


Control 
Schizophrenic 


Education, and Intelligence 


Age 


Intelligence 
Education Raw Vocabulary Score 
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Experimental Materials 


The Figure Placement task. The Street 
Scene and the Living Room Scene of the 
Make-A-Picture Story (MAPS) test consti- 
tuted the basic models for the background 
pictures. These scenes were redrawn (8} X 
11 inches) in pencil so that the horizontal di- 
mension was the main dimension of impor- 
tance, ie., the pictures were centered. The 
amount of structure of the scenes was changed 
and the size distortions corrected. An essen- 
tial copy of the Street Scene is presented in 
Fig. 1; of the Living Room Scene in Fig. 2. 

One of the male figures of the MAPS and 
a female figure drawn by the investigator were 
reproduced at three different sizes, 42, 3, and 
14 inches in height. An essential reproduction 
of the figures is shown in Fig. 3. 

The scenes and figures were sprayed with 
Krylon Crystal Clear Spray Coating in order 
to eliminate smearing. The regular stage of 
the MAPS with a sheet of galvanized iron in 
the slots, three small magnets, colored pencils, 
and onionskin paper constituted the remain- 
ing materials. 

The Doll task. McCall’s pattern No. 2000 
for a 16-in. rag doll was the basic model for 
the construction of the dolls. The pattern was 
increased and decreased by one-fourth of an 
inch in order to make three dolls of three dif- 
ferent sizes. The dolls had detachable legs, 
arms, feet, hands, and head. All parts could 
be joined by snaps. There were some snaps to 
which no body part belonged, two on the side 
of the head, two at the waist, and two im- 
mediately next to the head-body snap. The 
faces and buttons down the front of the bodies 











The Street Scene 





Fig. 2. The Living Room Scene 


were embroidered. There was a total of 3: 
pieces, 10 belonging to each doll. 

The Draw-A-Person task (DAP). A piece 
of plain white paper 84 x 11 inches and a 
No. 2 pencil were the materials for this task. 


Experimental Procedures 


All the Ss were administered all three tasks 
by the same examiner in one setting lasting 
approximately 40—50 minutes. 

The Figure Placement task. The Ss were 
seated immediately in front of the MAPS’ 
stage on which a plain piece of white paper 
had been placed. After a demonstration on 
the use of the magnets to hold the figures on 
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the stage, this paper was removed and the 
first scene presented. 

There were three trials for both scenes. On 
the first trial for each, all six figures were 
placed, in random order, on the floor of the 
stage. The Ss were told to place any three of 
the figures on the scene wherever they looked 
most appropriate—wherever they looked best 
to them. Only the two same-sized figures were 
used for the subsequent trials. The Figures A 
(42 in.), B (3 in.), and C (14 in.) were pre- 
sented, in that order, on both Trial 2 and 
Trial 3. 

Each placement was recorded by placing a 
piece of onionskin paper over the scene and 
marking the lower left-hand corner of the fig- 
ure with different colored pencils depending 
on the trial. 

The Doll task. The 30 pieces of the dolls 
were randomly spread out. The head of the 
largest doll, Doll 3, was held by the examiner 
and the following directions given: 


There are a number of pieces here. Some of them 
belong with this and some of them do not. I want 
you to take all the pieces which belong to this and 
put them together with this. Just snap the pieces on 
If you have any difficulty with the snaps, just let me 
know, and I will help you. Let me know when it 
looks all right to you. 


The Draw-A-Person task. The Ss 
given the following instructions: 


were 


I want you to draw a person 
the best you can. 


Do 


a whole person 


Scoring of the Experimental Tasks 


The Figure Placement task. The Figure 
Placement was scored by placing the onion- 
skin over 10 squares to the inch graph paper 
The placements were scored to the nearest 
tenth of an inch. The vertical dimension was 
recorded only to check the proper grounding 
of the figures. 

For both scenes, Trial 1, in which three 
figures were placed on the picture at one time, 
did not figure in the final scoring. This was a 
practice trial to familiarize the Ss with the 
backgrounds and figures and, in particular, 
the fact that the same-sexed figures were of 
the same person reproduced at different sizes 
—thus not a child or statue. 

Three judges made judgments as to the 
possible range of appropriate placements for 


each size figure on each background. The 
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mean of the range of their judgments was 
used as an index of the most appropriate 
placement for each figure on each _back- 
ground.® 

The final score for the Figure Placement 
was the absolute sum of the deviations from 
the mean appropriate placement for each size 
figure on each background. There were two 
other errors which indicated inappropriateness 
of placement. Both referred to the grounding 
of the figures. Grounding refers to placing the 
figures in a stable, upright position with the 
feet standing on a solid surface. Figures which 
are tilted are standing precariously on the 
ground, whereas the completely nongrounded 
figure gives the impression of floating in the 
air. Only those deviations which constituted 
unequivocal tilts or nongroundedness were 
scored. 

The Doll task. Connecting all the pieces be- 
longing to Doll 3 in an appropriate manner 
received a score of 0. Because of the impos- 
sibility of making dolls of absolutely propor- 
tionate parts, some minor errors were ex 
pected. Omissions and deviations in placement 
and size were scored in terms of whether they 
constituted minor or major errors. What con- 
stituted minor and major errors was decided 
upon a priori; however, some unanticipated 
errors occurred, thus necessitating some ad- 
dition of items. After the doll was completed, 
the placement and the size of the parts were 
indicated on a schematic diagram. 

The Draw-A-Person task. The drawings 
were scored according to a key which was 
developed on the basis of a pilot study which 
compared the DAP of 50 college students and 
50 schizophrenics, utilizing the Goodenough 
(1926) scoring system. The final scoring key * 
represents a modification of the Goodenough 
and includes those items which significantly 
differentiated the college Ss from the schizo 
phrenics, when age, educational level, and in- 
telligence were not controlled. The total score 


The judged mean appropriate placements on the 
Street Scene were as follows: Figure A, 1.8 in.; Fig 
ure B, 3.6 in.; and Figure C, 4.6 in. On the Living 
Room Scene, the judged mean appropriate place 
ments were as follows: Figure A, 1.6 in.; Figure B 

1 in.; and Figure C, 4.6 in 

*A 1-page scoring manual for 
with the American 
Order Document No 
microfilm or $1.25 for photocopi 


the DAP has been 
Documentation Insti 


5820, $1.25 f 


eposited 


tute remitting 
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for the DAP is the sum of the individual scor- 
ing points. 

The factors considered to be involved in 
space perception are position, direction, size, 
form, and distance (Warren, 1934). The 
tasks, in general, reflect varying degrees of 
structure in terms of spatial demands. The 
DAP is the least demanding. Here, the indi- 
vidual is confined only by the limits of the 
paper. He may define the human figure in 
any way he likes. The Doll presents more 
structure. It demands that the Ss organize the 
human figure in relation to the head which 
forms the central theme of the body image 
(Cohn, 1953). In the DAP, he can create the 
form, the size, and the relation of the body 
parts; in the Doll, he must follow the de- 
mands placed on him by the presentation of 
the head of a certain size in order for the 
form, size, and placement of the parts to ap- 
pear spatially appropriate. In the Figure 
Placement, the problem is much more struc- 
tured. The human form is created for the S 
and he must place it in appropriate relation- 
ship to fairly well-structured backgrounds. 
Botl. the Doll and the DAP are presumed to 
reflect primarily the problem of spatial per- 
ception and organization in relation to the 
body, and Figure Placement, the spatial prob- 
lem in dealing with the external world 


Hypotheses and Results 


A median test with a chi square test of sig- 
nificance (corrected for continuity) was used 
to evaluate all the differences between the 
groups. A one-tailed test was used throughout 
to evaluate the level of significance. 

Greater variability on all tasks for the 
schizophrenic group is predicted because of 
the varying degrees of reality severance that 
they clinically manifest and consequently, the 
varying degrees of disturbance of spatial per- 
ception which is expected. 


The Figure Placement Task 
1. Since the schizophrenic has no intrinsic 


frame of reference and because he experiences 
himself as boundless and: fluid, other objects 


A 1-page table giving the 
of both groups on all three 
with the American 
Document No 


or $1 


frequency distributions 
tasks has been deposited 
Documentation Institute. Order 
remitting $1.25 for microfilm 


5270 


Ss for photocopies 
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assume this fluid, nonstable quality. When he 
is asked to place a well-organized human fig- 
ure in appropriate relationship to a fairly 
well-structured background, that figure is not 
experienced by him as having definite form, 
bounds, and limits as it is experienced by 
nonpsychotic Ss. Consequently, having neither 
the well-delimited bounds of his own body 
as a reference nor being able to utilize the 
bounds and limits of the external world de- 
fined for him, it is predicted that the schizo- 
phrenic Ss place the figures significantly more 
deviant from the judged mean appropriate 
placement than the control Ss 

Table 2 shows that the schizophrenics did 
place the figures significantly more deviant 
from the judged mean appropriate placement 
than the controls, with the exception of the 
placement of Figure A on the Living Room 
Scene. The F tests indicate that the schizo- 
phrenics were significantly more variable in 
their placement of the human figure on fairly 
well-structured backgrounds than the control 
group on the task as a whole, on placing Fig- 
ure C on the Street Scene, and in placing all 
figures on the Living Room Scene. 

2. Furthermore, since the schizophrenic is 
not differentiated from the world, i.e., cannot 
maintain adequate distance between himself 
and external objects, it is predicted that he 
place the figures more to the foreground than 
the controls, i.e., in the direction of fusing 
with them. This prediction was supported by 
the following data 

The distance between the actual 
placement of Figure A and Figure C on both 
scenes was less for the schizophrenics than 
for the controls. On the Street Scene, the dis 
tance between the actual placement of Figure 
A and Figure C for the controls was 3.03 in., 
and for the schizophrenics, 2.09 in. On the 
Living Room Scene, the distance for the con 
trols was 3.39 in., and for the schizophrenics 
2.79 in. That is, the schizophrenics tended 
to cluster the figures more than the control 
group. That this clustering of the figures was 
toward the foreground was witnessed in the 
less distance between the placement of Fig- 
ure C and the (0.00) for the 
schizophrenics than for the controls. On the 
Street Scene, the distance between 
the placement of Figure C and the foreground 
was 4.80 in 


average 


foreground 


average 


for the controls, and 3.94 in. for 
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Table 2 


Comparison of the Control and Schizophrenic Groups 


the Figure Placement Task in Terms of the 


Deviation from the Mean Appr 


Control 
(N = 25) 


(N = 25 


Scene ‘ig M SD Vf 


Street 


Liv ing Room 


Combined 
Placements 


the schizophrenics. On the Living Room Scene, 
the average distance was 4.69 in. for the con- 
rols, and 3.84 in. for the schizophrenic group 

3. Since the schizophrenic does not experi- 
ence his body as having weight and solidity 
ind, therefore, in need of a solid surface on 
which to stand, it is predicted that the schizo- 
phrenic Ss evidence significantly more non- 
groundedness than the control Ss. The rela 
tive infrequency of the two types of non 
groundedness led to the decision to tabulate 
them together. Six of the controls and 11 of 
the schizophrenics gave one or more non- 
grounded responses, which is not statistically 
significant (y* = 1.426, p = .15). 


The Doll Task 


Body parts are not experienced as integral 
parts of the body by schizophrenic Ss. The 
form, size, and the position of body parts are 
distorted. These difficulties arise because of 
the breakdown of the bodily self, of the ex 
perience of its size, its unity, and its ex 
tensions. Nonpsychotics, whose bodies are 
well-bounded, do not show such disturbances 
in spatial perception. Thus, it is predicted 
that the schizophrenics receive a significantly 
higher error score and that they omit signifi- 
cantly more body parts, show more size dis- 
tortions, and more misplacements of integral 
parts of the body than the control Ss 

The schizophrenics did receive a signifi 
cantly higher error score (y* = 23.16, p 


Schizophreni 


priate Placement 


005), and were significantly more variable 
than the controls (F = 5.94, p = .01). Table 3 
shows the number of Ss in each group giv- 
ing one or more “pathological” responses on 
omissions, size, symmetry, reversals, and mis- 
placements. The inciden¢e of asymmetry was 
rare, whereas reversals, although they oc- 
curred, occurred with nearly equal frequency 
in the two groups. The minor misplacement 
»f placing the arm on top of the shoulder 
rather than to the end of the shoulder, oc- 
curred infrequently, but with approximately 
equal occurrence in the two groups. The chi 
squares for the incidence of omissions of inte- 
gral parts of the body, for size distortions of 
both a minor and major variety, and mis- 
placements of a major type, indicated that 
the schizophrenics did make significantly more 
errors and gave significantly more “pathologi- 
il” responses than the control Ss 


Draw-A-Person Task 


7 
i He 


It is predicted that schizophrenics show 
and their 
bodily self and, consequently, the breakdown 
of spatial perception, as reflected in the draw- 
ings of the human figure, by the omission of 
body parts and joints, by the lack of propor 
tion between the body parts, by transpar- 
encies, and by the lack of essential detailing 
vhich would indicate the human qualities of 
the figure significantly more than the control 


These errors 


the disorganization distortion of 


in general, reflect the schizo- 
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phrenic’s disturbance in the experiencing of .05 level of significance or better. The pres- 
his body size, of his solidness and unity as a_ ence or not of eyebrows, eyelashes, mouth, 
human form, and of his extensions. hands, arms, feet, and number of fingers did 

Schizophrenics did score significantly lower not differentiate between the groups. All of 
(x° = 8.052, p = .005), and were significantly the items referring to proportion and flexi- 
more variable (F = 2.08, p=.05) than the bility of the body did differentiate signifi- 
controls. Table 4 shows the comparison of cantly between the groups. Schizophrenics 
the control and schizophrenic groups on the showed significantly more transparencies with 
individual items of the DAP. Of the 24 items, reference to clothing, i. 


if clothing were 
14 differentiated between the groups at the present 


the body could be seen through ji 


Table 3 


Comparison of the Control and Schizophrenic Ss on the Doll Task 


Number of Ss 


Schizo 
Contro phrenic 
N = 25 V = 25 


Omissions 


Han 


1ot centered (3 
not symmetrical (3 
tf 


= 
symmetrical (35 


Reversals 


11 Arms reversed 
12. Legs reversed 


13. Body reversed 


Misplacements'* 


14. Arm-shoulder 


15. Arm-head (3 e 
16. Arm-waist (3 ¢ 

17. Arm-thigh (3 e 
18. Leg-waist (3 e 

19. Leg-chest (3 e 

20. Leg-shoulder (3 e& 
Leg-head (3 ex 
Leg-neck (3 ex 
Hand-leg (3 e 

24. Hand-head (3 e 


25. Foot-arm (3 e 


? 
? 


1 
2 
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Table 


Comparison of the Control and Schizophren 


Nun 


Contr 


Item* NV = 25 


Presence of 
1. Hair 

2. Hair-circumference 

3. Forehead 

4. Eyebrow 

5. Eyeiashes 

6. Chin 

7. Mouth 

8. Neck 

9. Shoulders 

10. Hands 

11. Arms 

12. Number of fingers 

13. Feet 

14. Clothing 


Proportion 
15. Head 
16. Arms 
17. Legs 
Flexibility 
18. Shoulder or elbow joint 
19. Hip or knee joint 
20. Arm attachment 
21. Leg attachment 


Transparencies 


Clothing 
Outline of hea 


24. None 


There was no significant difference between 
the groups in showing transparencies in ref- 
erence to the head, i.e., seeing the outline of 


the head through the hair. 
Discussion 
The over-all results of this investigation 
lend support to the Des Lauriers hypotheses 
on the conditions which are necessary for the 
development of a sense of reality. The signifi 
cance of the difference between the control 
and schizophrenic groups in terms of errors 
on both the Doll and the DAP was taken to 


indicate that the schizophrenics do have a 


| 
? 


ic Ss on the Individual Items of the DAP 


ignificant problem in the perception of and 
organization of the body in relation to space 
Despite the extreme and predicted variability 
of the schizophrenic group, the difficulties in 
spatial perception were sufficiently paramount 
not to be cancelled out by this variability. 
Che results of both the Doll and the DAP in 
dicated that the schizophrenics distort size 
misplace body parts, and omit essential parts 
of the body. 

That the schizophrenics as compared with 
the controls failed to indicate that the arms 
ind legs of the human figure were capable of 


moving, i.e., that they were attached appro 
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priately and had well-defined joints, is of par- 
ticular interest suggesting, as we are led to 
believe from our knowledge of psychoanalytic 
ego psychology and our knowledge of the de- 
velopment of the bodily self, that movement 
is of importance for differentiating the body 
from the world. Freud (1953b) stresses the 
importance of movement in differentiating be- 
tween stimuli which come from within the 
body and stimuli which come from without 
Schilder (1953) feels that actions are of such 
importance in differentiating the me from the 
not me, that he states that if action were not 
possible that the body and the world would 
be one. In line with Des Lauriers’ theoretical 
postulates, it is hypothesized that in schizo- 
phrenics there is a breakdown of the delinea- 
tion of the body from the world. That the 
schizophrenics did not clearly and _ signifi- 
cantly indicate the potentialities for move- 
ment is taken as support for this theoretical 
postulate. 

The schizophrenic is obviously capable of 
movement, but he tends not to experience 
himself as the one moving—as the prime ini- 
tiator of his actions. Nor does he see the con- 
sequences of his action on another and realize 
that it is he who is doing thus and so. The 
effectiveness of Des Lauriers’ therapeutic ef- 
forts with schizophrenic children in which he 
focusses considerable attention in pointing 
out the effect of movement on his part on the 
child, as well as the effect of movement on 
the child’s part on him, adds support to such 
an understanding. 

The results of the Figure Placement clearly 
indicated the inappropriateness of the schizo- 
phrenic’s spatial perception and the severity 
of the problem which he experiences in at- 
tempting to relate his body to the world. 
Weckowicz (1957) has stated that the schizo- 
phrenics tend to overestimate distance and 
underestimate the size of objects seen at a 
distance. The results of this investigation, 
with the particular stimulus materials which 
were used, led to the opposite conclusion, 
namely, that the schizophrenics underestimate 
distance and overestimate the size of objects 
seen at a distance. This finding was in line 
with the prediction that the schizophrenics 
tend to fuse with the world, i.e., that they are 
unable to maintain sufficient distance between 
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themselves and the world. With different 
stimulus materials and assuming with Ek- 
stein and Wright (1952) some capacity for 
“defensive maneuvers” it may be that Wec- 
kowicz’s results would be confirmed. We did 
not assume, in this investigation, that the 
schizophrenic had such a capacity for “defen- 
sive maneuvers,” since it would imply that 
he, in the first place, was capable of ap- 
preciating distance, and only as a second 
thought, so to speak, removed himself to the 
background. 

That the breakdown of the sense of reality 
involves a breakdown of the bodily self was 
witnessed by the omissions of integral parts 
of the body, by the disproportionate size of 
the body, by the misplacements and failure 
to maintain proper spatial relations between 
parts of the body, and by the inability of the 
schizophrenic Ss to place the body in appro- 
priate spatial relationship to the world. That 
this breakdown of the bodily self is a conse- 
quence of insufficient cathexis of the body is 
assumed supported by the nature of the logi 
cal deductive reasoning used in this experi- 
ment. If there were no loss of cathexis, there 
would be no breakdown of the bodily self; if 
there were no breakdown of the bodily self, 
there would be no disturbance in spatial rela 
tions and organization. 

Certainly, the tasks are related to spatial 
relations and organization. What part other 
variables may play in accounting for the sig- 
nificant results cannot be determined by the 
present study; however, the results cannot be 
accounted for on the basis of age, sex, edu 
cation, or intelligence since the groups were 
equated on these variables. Shakow (1946) 
has suggested that many of the significant 
findings which differentiate between schizo- 
phrenic and control Ss are attributable to the 
lack of cooperation and interest of the schizo- 
phrenics rather than to the particular variable 
or variables which the experimenter is investi 
gating. We do not think this to be true in our 
present research. Only those schizophrenic Ss 
who were judged by their ward psychiatrist 
to be cooperative and who did willingly co- 
operate in this investigation were used. All 
the control Ss volunteered and thus their co 


operation was assured. We assume, then, that 
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it is not a lack of cooperation which is deter- 
minant for our significant results. 

Since it was necessary to make modifica- 
tions in the Doll scoring system on the basis 
of the data, its sensitivity in significantly dif- 
ferentiating a control from a schizophrenic 
group must be cross-validated. 


Summary 


The purpose of this study was to explore 
one of the implications of Des Lauriers’ theo- 
retical postulates regarding the conditions 
necessary for the development of a stable 
sense of reality. 

Twenty-five hospitalized schizophrenic 
women and 25 nonhospitalized women were 
administered three tasks, Figure Placement, 
the Doll, and the DAP, all of which involved 
active dealing with spatial relations and or- 
ganization. Disturbances in dealing with the 
Doll and DAP were presumed to reflect pri- 
marily the spatial problem of dealing with 
the body, and Figure Placement, the spatial 
problem of dealing with the relationship of 
the body to the world. 

As predicted, the schizophrenic group made 
significantly more errors and was significantly 
more variable on the over-all tasks than the 
controls. The prediction also was made that 
‘the schizophrenics would make significantly 
more errors and be significantly more variable 
than the control group on the component 
spatial factors involved in each task, such as 
size, position, form, and distance. For the 
most part, when there were frequent enough 
occurrences of the items, the results were sig- 
nificant and in the direction predicted. 

The results of this investigation add to the 
validation of the Des Lauriers’ hypotheses 
Significant disturbances in spatial perception 
in reference to the body, and in reference to 
the body and the world were found. This 
breakdown in spatial relations and organiza- 
tion is interpreted as an indication of the 
breakdown of the bodily self. The breakdown 
of the bodily self is interpreted to be a con- 
sequence of a diminution of narcissistic ca- 
thexis of the body. 
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In two previous articles (Maier, 1956; 
Maier & Ellen, 1951), the evidence on which 
Maier’s (1949) theory of frustration was built 
has been critically examined in the light of 
alternative interpretations of the data. In both 
instances the evaluation of the literature re- 
vealed that the crucial aspects of the experi- 
mental data had not been satisfactorily met 
by other theorists. Thus one might conclude 
that this theory of frustration best iniegrates 
the data on which it is based, but the ques- 
tion of whether it does justice to other ob- 
servations and experimental findings still re- 
mains. 

According to this theory, an organism’s be- 
havior potentials can be described as its reper- 
toire of behavior, which, in line with most 
is determined by heredity, growth 
conditions, and experience. The expressed or 
observed behavior, however, is a function of 
both the behavior repertoire and _ selective 
processes or mechanisms. The unique aspect 
of Maier’s theory is the postulation of two 
selective precesses; 


theories. 


one operating under con- 
ditions of motivation, the other under condi- 
tions of frustration. These two mechanisms 
are basically different, the former selecting 
behavior according to the ways in which it is 
perceived to achieve incentives that satisfy 
needs; the latter, according to other princi- 
ples as yet incompletely explored but different 
in kind from those operating under conditions 


of motivation. If the motivation process is op- 


erating during problem-solving performance, 


‘ The authors are indebted to Daniel R. Miller and 
L. Richard Hoffman of the 


| University of 
for helpful suggestions 


Michigan 
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Northampton, Massachuett 


then frustrated behavior not only makes prob- 
lem solving incidental to the needed goal ob- 
ject, but may actually be in conflict with it. 
Thus it lacks goal-orientation and therefore 
represents a class of behavior without a goal 
Such behavior is determined largely by condi 
tions inside the organism, so that the expres- 
sion of and feelings, rather than 
what they achieve, characteristically accom- 
pany behavior 
frustration 


emotions 
under conditions of 
The environmental condition of 
availability rather than need-satisfying prop- 
erty appears to become dominant during frus 
tration. If behavior instigated by frustration 
is adaptive, at times, this is due to natural 
selection rather than to the organism’s ability 
to solve a problem. Thus an angry person 
may strike a man who blocks his path and 
the man may collapse. However, if the cause 
of the blow is anger rather than the removal 
of the obstacle, the 
the purpose. 


selected 


success is incidental to 

Behavior expressed under conditions of frus 
tration is characterized by some combination 
of aggression, regression, and fixation (com 
pulsion) ; in contrast to behavior expressed 
under conditions of motivation which is char 
acterized by variability, constructiveness (ma 
turity), and the exercise of freedom of choice. 
A problem situation or obstacle in the path, 
therefore, may either motivate an organism 
to show problem-solving behavior or frustrate 
him to show destructive, rigid, or immature 
behavior. The outlook in instance 
“what to do,” in the other it is blaming, hos- 
tility, or self pity. Which of these types of 


one is 


behavior is expressed depends upon the con- 
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dition of the organism, since the same objec- 
tive problem may cause both types of behav- 
ior to appear in a group of individuals. 

The definitions of problem situations and 
of frustrating conditions are basically alike; 
the difference is in the behavior observed. 
This does not mean that some situations may 
not be more likely to frustrate people than 
others; rather, a crucial condition—an ob- 
stacle in the path of a goal—is a common 
characteristic of both. A determining differ- 
ence in such situations is the amount of pres- 
sure or force exerted in requiring that the 
obstacle be circumvented. This pressure may 
serve either to motivate or to frustrate, and 
therefore produ-e opposite effects. 

Although some individuals are more prone 
to show frustrated behavior than others, or- 
ganisms are alike in that each possesses two 
qualitatively different behavior possibilities. 
This means that operational definitions of 
frustration and problem situations are essen- 
tially incomplete since the organism in ques- 
tion determines what effect obstacles and 
pressure will have on it. It follows, therefore, 
that even though situations may differ in de- 
gree, the organism’s behavior will differ in 
kind. 

The three concepts that characterize frus- 
tration theory, and therefore serve as critical 
areas for testing it, are (a) the assumption of 
a frustration threshold; (5) the postulation 
of a qualitative distinction between behaviors 
instigated by frustration and by motivation; 
and (c) the adoption of the principle of avail- 
ability to account for the selection of re- 
sponses that are expressed during frustration 
(as contrasted with the function of needs or 
excitatory values in motivated behavior). 

These three concepts were developed in or- 
der to account for research findings obtained 
from the study of rats in a specific type of 
conflict situation. If they serve to interpret 
human behavior under stress, as well as ani- 
mal behavior in widely different situations, 
there will be reason for assuming that these 
assumptions are fundamental principles. 

Although psychoanalytic theory and frus- 
tration theory may make some of the same 
predictions, it is clear that the reasons sup- 
plied and the principles used will be different 
in origin and in kind. It is recognized, there- 
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fore that in some instances two or more theo- 
ries may make similar predictions and will 
have to be evaluated by additional criteria. 
With respect to the appearance of qualitative 
distinctions, psychoanalytic theory and frus- 
tration theory have some common features 
and some differences. For example, frustration 
theory may predict a bimodal distribution 
of results, while psychoanalytic theory may 
assume qualitative differences (discontinuous 
distributions) because the concept of levels or 
steps is inherent in the theory. For example, 
a child’s relations with his mother may show 
qualitative changes as he moves from one 
psychosexual stage to another. However, the 
concept of levels does not limit the findings 
to bimodal distributions in behavior data, and 
this difference can lead to critical tests. An- 
other difference is that frustration theory pre- 
dicts behavior differences due to two physio- 
logical mechanisms, whereas psychoanalytic 
theory stresses cultural (learned) factors as 
causes of the differences. Finally, psychoana- 
lytic theory would make one cautious in ap- 
plying the theory to subhuman forms, whereas 
frustration theory has its origin in the study 
of animals below man and stresses a biologi- 
cal approach. If frustration-instigated behav- 
ior has survival value it is due more to natu- 
ral selection than to problem-solving or deci- 
sion-making. 

It is not our attempt to determine whether 
one theory has more universality than another 
or whether frustration theory is the only one 
that can explain certain phenomena. Rather it 
is hoped that the universality of its basic as- 
sumptions will be better appreciated if the 
theory is seen in relationship to a larger va- 
riety of data and behavior settings. Since the 
analysis of data, in part, depends upon the 
theory that is tested it is hoped that other 
researchers will see fit to test their findings in 
relation to frustration theory. At the present 
time the failure to test for bimodal distribu- 
tions in data makes it impossible in many in- 
stances to evaluate frustration theory, and 
this oversight may lead to the loss of critical 
information. 


The Frustration Threshold 


Frustration theory postulates that behavior 
that is constructive, motivated, problem solv- 
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ing, or goal oriented in nature may suddenly 
be replaced by behavior that is hostile (ag- 
gression), immature (regression), stubborn 
(fixation), apathetic (resignation), or some 
combination of these symptoms whenever the 
frustration threshold of the individual is ex- 
ceeded. It is also assumed that individuals 
will show either constructive or nonconstruc- 
tive type of behavior in a stressful situation, 
depending on the height of their frustration 
thresholds. 

An experiment critical of these assumptions 
would be one in which the introduction of 
something moderately threatening or stressful 
caused all of the members of a group to be- 
have in the same direction. According to frus- 
tration theory, stress (punishment) can serve 
as a negative incentive or as a frustrating 
agent, depending on whether the frustration 
threshold of the individual has been passed. 
As a consequence, punishment for aggression 
should cause some children to show an in- 
crease in aggressive behavior, while others 
should become less aggressive. Furthermore, 
an increase in punishment should increase the 
amount of group aggression, primarily by in- 
creasing the number of persons whose frus- 
tration thresholds are exceeded. 

There are a variety of ways in which frus- 
tration may be induced, but these do not in- 
fluence the basic character of frustrated be- 
havior. Punishment and difficult problem 
situations are the most commonly used ex- 
perimental methods for introducing stress. 
The experience of failure looms in importance 
as one attempts to reconcile findings. 

A brief examination of the literature indi- 
cates the applicability of the concept of a 
frustration threshold. Allport, Bruner, and 
Jandorf (1949) have pointed out quite con- 
clusively that stress and/or frustration does 
not cause all of the members of a group to 
react in the same way. Analyzing the data 
from life histories of 90 Jews exposed to the 
terror of Nazism, these authors were able to 
identify quite distinct behavioral reactions to 
the stress of National Socialism in Jews in 
Germany. Among the reactions manifested 
were resignation and defeatism, regression 
and fantasy reactions, conformity to the new 
regime, aggression and displaced aggression, 
and planning behavior and activities aimed 
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at coping with the threat of Nazism by get- 
ting out of Germany. Clearly here, the stress 
of Nazism caused behaviors in some Jews that 
might be considered maladjustive (resignation, 
regression, displaced aggression) and in others, 
behaviors which can be classified as construc- 
tive. The authors point out that the simple 
frustration-aggression hypothesis of the Yale 
group (Dollard, Doob, Miller, Mowrer, & 
Sears, 1939) is quite inadequate to account 
for the wide range of behaviors exhibited un- 
der stress. The variations in behavior mani- 
fested and the possibility of grouping certain 
behaviors as constructive and others as non- 
constructive or destructive points to the need 
for the postulation of a threshold principle to 
account for apparently contradictory results. 

The research of Barker, Dembo, and Lewin 
(1941) dealing with the effects of frustration 
on play behavior also reveals opposite reac- 
tions to interferences with need satisfaction. 
Out of 30 children, 5 showed an increase in 
constructiveness, whereas 25 showed a de- 
crease in the constructiveness of the play be- 
havior when the barrier was lowered separat- 
ing the child from the highly valued toys. All 
of the 5 children showing an increase in con- 
structiveness were in the group defined as the 
weak frustration group (those which showed 
relatively little time in performing frustration- 
instigated behavior, such as aggression against 
the barriers, etc.). Again, it is apparent from 
these data that introducing stress into a situa- 
tion does not cause the same kind of behavior 
in all members of a group 

Other data show that the postulation of dif- 
ferences in frustration thresholds clarifies the 
appearance of splits in a population when 
stress is introduced. Block and Martin (1955) 
in a partial replication of the Barker, Dembo, 
Lewin experiment attempted to account for 
the observed differences in play behavior by 
relating them to some other personality vari- 
able defined as “ego-control.” Ego-control was 
measured in terms of the ability of a child to 
delay gratification (collect candy without eat- 
ing it), co-satiation (continue working on a 
task on which they had been saturated), and 
finally, on observed ratings of ego-control 
The specific predictions made were that the 
overcontrolling child will exhibit less decre- 
ment in constructiveness in play between pre 
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frustration and frustration situations than the 
undercontrolling child. Hence, a negative cor- 
relation should exist between change in play 
constructiveness and either delay of gratifica- 
tion scores, or co-satiation scores. The results 
obtained were in the predicted direction and 
statistically significant. 

It would appear from the consideration of 
these studies that some sort of threshold con- 
cept is of value in the analysis of data from 
studies concerned with the effects of stress 
and/or frustration. In addition, the Block- 
Martin data suggest some of the parameters 
that may be related to a frustration threshold. 
The fact that individual reactions to stress 
frequently are of an opposite nature indicates 
the difficulty of reporting results in terms of 
group trends. Merely reporting the average 
decrease in constructiveness of play as a func- 
tion of frustration hides the fact that indi- 
viduals reacted to the stress in different ways. 
The inconsistent findings on the motivating 
value of stress likewise point up the need for 
analysis of individual differences. 

The postulation of a frustration threshold 
also may serve to explain why the Yale re- 
searchers (Dollard et al., 1939) were unable 
to obtain a correlation between the degree of 
aggravation introduced and the amount of ag- 
gression expressed. The concept of a threshold 
makes a change in behavior an all-or-nothing 
phenomenon, such as Maier and Feldman 
(1948) obtained when they varied the length 
of time rats were exposed to the insoluble 
problem situation. 

Recently, Shimoyama (1957) repeated this 
study but varied the degree of frustration in 
the insoluble problem by using four fre- 
quencies of punishment (0%, 30° 50%, 
and 70%) supplied randomly. He found that 
the number of rats with fixations increased 
with the punishment ratio, the percentages 
being 0, 18, 30, and 60. No differences in the 
strengths of the fixations were obtained, how- 
ever. This means that all group differences 
were due to the number of animals showing 
the rigid behavior. Shimoyama followed the 
Maier-Feldman method of guidance alter- 
nated with trial and error for breaking fixa- 
tions thus making it possible to measure these 
strengths. 
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The Qualitative Distinction 


The assumption of a threshold concept to 
account for the changes in behavior that oc- 
cur during frustration implies that the process 
underlying behavior expressed during frustra- 
tion is qualitatively different from the process 
underlying problem-solving or goal-oriented 
behavior, since different behavior mechanisms 
would be put into operation. Thus in frustra- 
tion theory it is assumed that frustration- 
instigated behaviors differ from goal-oriented 
behaviors in terms of the way in which they 
are related to the stimulus and behavior se- 
quences. If two behavior mechanisms exist, 
behavior data should be clearly divisible into 
two types. The classifications goal-oriented 
and frustration-instigated reflect the way 
Maier (1949) originally divided behavior in 
a problem situation. Accordingly, goal-ori- 
ented behavior was described as a means to 
an end (goal) and which is terminated when 
the end is reached or the need is satisfied. 
Frustration-instigated behavior was described 
as an end to a sequence and which terminates 
itself when full expression is possible and 
further aggravation to reinstate the sequence 
is not supplied. Because it terminates a unit 
of behavior the latter type is more closely 
linked to the situation in which the organism 
finds itself than is goal-oriented behavior. Ac- 
cording to frustration theory, the search for 
reinforcement, need-reducing state of affairs 
or purpose in frustration-instigated behavior 
is an unrewarding task. In fact this mental 
set may lead to the postulation of need sys- 
tems, which often are anthropomorphic and 
not subject to direct empirical verification. 

The value of this simplifying feature of 
frustration theory is very cogently illustrated 
by the elaborate need system developed by 
Ullman (1958) to account for the appear- 
ance of “compulsive” eating behavior in rats, 
ind the one developed by Mowrer and Viek 

1948) to account for eating inhibitions in an 
escape situation. Failure to entertain the pos- 
sibility of a basic dualism at the outset forced 
them to assume even greater complexities and 
diversity later on in order to reconcile incon- 
sistencies and to correct for theoretical dis- 
crepancies. The above illustrations taken from 
the experimental literature are reminiscent of 
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the period 25 years ago when lists of instincts 
were developed in order to explain behavior. 

The postulation of the qualitative distinc- 
tion between frustration-instigated behavior 
and motivated behavior, together with the 
concept of a frustration threshold also makes 
it possible to put some order into the theo- 
retical difficulties created by the data ob- 
tained from avoidance conditioning experi- 
ments. According to frustration theory, a 
noxious stimulus acts as a negative incentive 
unless or until it is of such duration or in- 
tensity that it crosses the frustration threshold 
of the subject. The learning and extinction 
of avoidance and approach responses should 
obey the same laws, just so long as frustra- 
tion does not enter the picture. However, if 
our assumptions are correct, frustration is 
more likely to complicate the picture when 
avoidance behavior is investigated. This pre- 
diction does not follow from motivation and 
learning theories. 

In the case of the extinction of avoidance 
behavior, the data of Solomon and Wynne 
(1954) are of interest. They report that after 
only 3 or 4 shocks which were just subteta- 
nizing and with a 10-sec. CS-UCS interval, 


the instrumental avoidance response of jump- 
ing a barrier became more and more stereo- 
typed and the latency of the response became 
shorter (levelling off at 1‘ sec.). Dogs typi- 


cally continued to resp: to the CS for sev- 
eral hundred trials without showing any signs 
of extinction. Additional data by Solomon, 
Kamin, and Wynne (1953), however, show 
that under certain conditions extinction of 
these responses can occur, although the ex- 
tinction was not complete in that some of the 
animals still failed to extinguish. Thus, when 
a combined procedure of preventing the re- 
sponse by placing a glass barrier in front of 
the hurdle and punishing the response was 
used, 14 out of 16 animals were able to ex- 
tinguish their conditioned avoidance responses. 
Certain additional features of the experiment 
remain to be pointed out. First, all these ani- 
mals had an intervening extinction procedure 
before the combined glass barrier and pun- 
ishment extinction procedure was used. In 
six of the animals, a glass barrier extinction 
procedure alone was used for 10 days prior 
to the introduction of the combined extinc- 


Frustration Theory 199 
tion procedure, and for 10 of the animals a 
punishment extinction procedure alone was 
used for 10 days before the combined extinc- 
tion procedure was instituted. When the data 
are analyzed in terms of this procedural 
breakdown, it was found that all 6 of the ani- 
mals which received the glass barrier pro- 
cedure prior to the combined extinction pro- 
cedure extinguished their avoidance responses, 
whereas only 8 out of 10 of the animals which 
received the punishment procedure extin- 
guished. Furthermore, the mean number of 
punishment shocks in the combined extinc- 
tion procedure reflected the influence of 
whether the prior extinction procedure was 
the glass barrier or the punishment. That is, 
the six dogs that had the glass barrier prior 
to the combined procedure required only 8.2 
shocks in the combined procedure, while the 
animals that had the punishment procedure 
required an average of 14.3 shocks, a differ- 
ence which is significant at the .01 level. The 
important facts of this investigation that re- 
quire explanation are (a) the failure of ordi- 
nary extinction procedures (omission of the 
UCS) to cause extinction, (5) the differences 
in extinction between animals receiving the 
glass barrier treatment and animals receiving 
a punishment extinction procedure prior to 
the combined procedure, and, finally, (c) the 
failure of extinction in some cases even un- 
der the best of the extinction procedures. 
Solomon and Wynne’s principle of the con- 
servation of anxiety seems adequate to ac- 
count for the first fact—the failure of extinc- 
tion to occur when merely the UCS is omitted. 
In other words, the short-latency avoidance 
reactions prevent the CS from arousing anx- 
iety reactions, thereby conserving conditioned 
anxiety reactions from extinction. Also it can 
handle instances in which extinction occurs 
when only the glass barrier extinction pro- 
cedure is used. However, the principle does 
not account for the fact that some ani- 
mals never extinguish even under the best of 
extinction procedures. This fact of the bimo- 
dality—the split in the population—is di- 
rectly explained by frustration theory be- 
cause it postulates the existence of a frustra- 
tion threshold. Thus animals that become 
frustrated by the UCS will never extinguish 
in the usual way, whereas those with thresh- 
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olds sufficiently high to resist the frustrating 
effects of the UCS will be able to extinguish 
under certain experimental conditions. Fur- 
thermore, the difference in the proportion of 
animals extinguishing among those exposed 
to the glass barrier procedure and those ex- 
posed to the punishment procedure prior to 
the combined procedure also can be readily 
explained in terms of the dual effects of 
punishment postulated by frustration theory. 
Thus, the animals exposed to the punishment 
procedure prior to the combined procedure 
received more punishment for the avoidance 
response than did animals exposed to the prior 
glass barrier procedure. According to frustra- 
tion theory, this additional punishment served 
to make the former group rigid (i.e., resistant 
to extinction), because a greater number of 
the animals had their frustration threshold 
exceeded. The increased resistance manifested 
itself both in the number of shocks required 
in the combined procedure and in the smaller 
number of animals extinguishing. 

Frustration theory does not require that all 
rigid behavior have its basis in frustration. 
Rather, this condition is but one of several 
under which the behavior of an organism may 
exhibit persistence. Other conditions are over- 
learning, the operation of special needs, per- 
ceptual differences, and low intelligence. Thus, 
the failure of extinction in avoidance behav- 
ior may either reflect the operation of a 
frustrated condition, and thus be an instance 
of abnormal fixation, or simply result from 
the lack of a perception of more adaptive al- 
ternatives, due to the nature of the particular 
experimental situation. A learning-motivation 
concept, such as the conservation of anxiety, 
readily accounts for the latter alternative but 
is inadequate to account for the first. 

The dual operation of noxious stimuli 
(either as a negative incentive or as a frus- 
trating agent) should also be reflected in 
other types of learning experiments that uti- 
lize them as training aids. If parameters such 
as intensity of noxious stimulus or the num- 
ber of reinforced repetitions are used, learn- 
ing and motivation principles would predict 
a whole spectrum of response strengths when 
a random population is tested. However, frus- 
tration theory would predict a bimodal dis- 
tribution of response strengths; fixated and 
nonfixated. For example, if shock were used 
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as a driving stimulus, it would be predicted 
that the percentages of animals falling into 
the fixated group within a given level of shock 
intensity would increase as the shock inten- 
sity increased, but the strength of the fixa- 
tion would not change. If such an experiment 
yielded several groupings of response strengths 
that were a function of the intensity of the 
noxious stimulus, a case could be made against 
the necessity for postulating a frustration 
threshold and the qualitative difference be- 
tween fixated behavior and ordinary habits. 

The part played by needs in determining 
response strength might be tested by using 
different kinds of noxious stimuli. If the re- 
sults yielded as many groupings of extinction 
scores as types of noxious stimuli used, then 
a strong case would bé made for the view- 
point that response strength is a function of 
the type of motivation used and that differ- 
ences in types of motivation can cause splits 
in a population. Frustration theory, however, 
would demand bimodal distributions within 
each type of noxious stimulus. 

A study by Hammes (1956) may be used 
to illustrate the dual effects of noxious stimu- 
lation when used as a training device. In an 
experiment utilizing two levels of task diffi- 
culty and three levels of shock motivation, 
rats had to learn to escape from a shock box 
through the one of two doors that had the 
correct card on it. Performance was measured 
in terms of two criteria: (a) the number of 
trials to learn and (0) the number of errors 
made. In the easy task (black-white discrimi- 
nation) three intensities of shock motivation 
(low, medium, and high) caused only one 
failure to learn (i.e., reach a 10 successive 
errorless trial criterion) in each condition. 
However, in the difficult task (discrimination 
between two circles with a 4-1 size differ- 
ence) the number of animals failing to reach 
the criterion of learning increased from 6 to 
10, as the shock intensity increased. Of in- 
terest from the point of view of frustration 
theory is the fact that (a) bimodal distribu- 
tions were obtained with each of the differ- 
ent levels of motivation used, and (5) the 
number of animals falling into the failure 
group increased as the level of shock was 
raised. Hammes, however, treated his data in 
terms of group averages, and as a result these 
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important aspects of the data were not em- 
phasized in his paper. 

Behaviors that are similar on the surface 
but that have different origins also may be 
expected to show basic differences when fur- 
ther analyzed. For example, crimes may be 
committed because they are perceived as the 
solution to a problem for the individual or 
because they reflect a hateful or antisocial 
condition. It is possible, therefore, to consider 
some crimes as either motivational or the 
product of frustration. If this is the case, cure 
and prevention would ° fer depending on the 
type of origin. It is a0 possible that these 
two processes may supplement each other 
since the behavior they elicit is not neces- 
sarily in conflict. 

A paper by Jenkins (1955) describing two 
qualitatively different types of delinquency 
supports this analysis. In his treatment he 
differentiates delinquency as an adaptation 
from delinquency as a maladaptation. In the 
former instance, delinquent behavior differs 
from normal behavior only in its illegality. 
Its motivational aspects (acquisition, plan- 
ning, integrated action, etc.) are the very 
ones which our culture sanctions and which 
keep our competitive economic system func- 
tioning. However, the delinquent behavior 
which he categorizes as maladaptive is “an 
explosion of blind destructiveness in which 
the individual utterly loses control of him- 
self” (p. 10). It represents a renunciation of 
goals rather than the selection and pursuit of 
a goal. Jenkins further asserts that these two 
types of delinquency have a different origin. 
In adaptive delinquency there is evidence of 
a lack of paternal guidance but with a ma- 
ternal care adequate for developing social re- 
sponsiveness. In the maladaptive delinquency, 
however, there is evidence of primary need 
frustration. Typically the child is unwanted 
by both parents, particularly the mother, with 
the result that no social responsiveness can 
develop. Finally Jenkins points out that the 
distinction has definite implications for treat- 
ment. In the case of adaptive delinquency, 
the emphasis must be placed upon thwarting 
the delinquent activity. In the maladaptive 
delinquent, the emphasis must be placed on 
reducing the frustrating conditions that create 
the delinquency. As an example, he empha- 
sizes the development of warm interpersonal 
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relationships, which must be maintained de- 
spite unacceptable behavior. 

Observations of cases of problem readers 
likewise support this approach. It is well 
known that therapy helps some problem read- 
ers more than drill in reading, whereas for 
other children the reverse is true. Research is 
needed to test and evaluate these observa- 
tions. If frustration theory is to serve as a 
guide it follows that mentally retarded chil- 
dren need motivation and drill; whereas frus- 
trated children need therapy to get rid of 
their frustrations, including the resultant re- 
gression. 


The Principle of Availability 


Frustration theory postulates that when an 
organism is in a state of frustration, the 
mechanism for selecting or determining be- 
havior differs from the one that operates dur- 
ing conditions of motivation. The theory 
states that the specific character of the re- 
sponse elicited will be determined by its de- 
gree of availability to the subject, and that 
the response will have the property of ag- 
gression, regression, fixation-rigidity, or some 
combination of these. 

Although the mechanisms for response se- 
lection under conditions of motivation vary 
somewhat with the point of view of the 
theorist, the factors usually mentioned include 
excitatory value of stimulus, the needs of the 
individual, the previous training of the indi- 
vidual, and certain perceptual factors. Al- 
though availability may be implied in some 
of these instances it is not usually regarded as 
a determining influence largely imposed by 
the environment. Rather, response selection 
under motivation is consistent with the psy- 
chology of choice behavior, which in turn 
gives the organism a determining role in its 
own behavior. Behavior elicited during frus- 
tration, in contrast, takes on a character of 
compulsiveness so that the organism may be- 
have in a manner that is inconsistent with its 
choice. 

Factors which make one response more 
available than another require further investi- 
gations to clarify the limitations. However, 
enough is known to include conditions such 
as physical nearness, biological ease (includ- 
ing the response in progress), natural or un- 
learned preferences, primitiveness or simplicity 
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of response, previous experience or training, 
and cultural or sociological influences. 

Although these factors are basically differ- 
ent, they have one thing in common: they 
make certain responses more accessible to the 
organism than others. However, the fact that 
there is a multitude of determinants makes 
complete prediction difficult. One can test 
them only by equalizing the other determi- 
nants while testing one. Whether it will even- 
tually be possible to assign weightings to the 
factors so as to increase prediction remains a 
question. It is likely that individual differ- 
ences will exist and that the weightings will 
fail to generalize completely. 


Physical Nearness 


According to this principle, things or per- 
sons near to the frustrated individual will 
tend to be involved in the behavior to a 
greater degree than other objects. Thus a 
frustrated person is likely to vent his hostili- 
ties on a person physically close to him. Like- 
wise the frustrated person is inclined to use 
objects that are handiest for attack, rather 
than most efficient. For example, a woman 
may throw a plate while drying dishes but 
will strike out with a broom while sweeping. 

This factor is consistent with the observa- 
tion that a frustrated individual often attacks 
innocent bystanders, which is a puzzle from 
the view-point of problem-solving. It also ex- 
plains why the source of frustration some- 
times is attacked since, in many instances, 
the object of frustration is near to the per- 
son who is frustrated. Banging on locked doors 
during fires or while imprisoned, even to the 
point of causing self-injury, is not uncommon. 

Specific experiments testing this factor have 
not been designed, but there is a good deal 
of observational data to support it. Barker, 
Dembo, and Lewin (1941) described children 
kicking teachers and barriers, and the Yale 
group (Dollard et al., 1939) described how 
subjects by their drawings vented their frus- 
tration on the experimenters. The reported 
negative correlation between the price of cot- 
ton and the number of negroes lynched in the 
South is also in line with this factor. 

Vandalism and thefts of useless objects, 
which are difficult to explain on a problem- 
solving or motivational basis, may readily 
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lend themselves to explanation in terms of 
this factor. 


Biological Ease and the Response in Progress 


Other things being equal, the response se- 
lected under frustration is likely to be one 
that is convenient for the individual because 
of his make-up or particular environmental 
circumstances at the time of frustration. Push- 
ing is easier than pulling, and kicking is 
easier under some conditions than others. 
Thus the form of aggression may vary with 
individuals and with circumstances. Response 
fixation may also be influenced by ease or 
convenience. A forward movement is easier 
than a turn, and continuation of a response 
is easier than a change. For this reason, the 
response in progress at the time of frustra- 
tion tends to be highly accessible, unless the 
conditions of frustration block it in some 
way. 

An experimental demonstration of this fac- 
tor was made by Kleemeier (1954). He trained 
some rats to go right, others left, and still 
others to go straight ahead at a junction in 
a maze. Mastery of one of these responses 
was their first habit. He then tried to develop 
a second habit by punishing the rats with 
electric shock for following the first habit. It 
was found that punishment fixated responses 
but that other factors determined which re- 
sponse became fixated. Usually either the old 
response (the one in progress) persisted or a 
response to the alley lying straight ahead (the 
one most accessible) was fixated. When the 
forward alley was the initial response, it was 
seldom abandoned. ‘This experiment nicely 
demonstrates how the physical arrangement 
of a situation and the response in progress 
makes certain behaviors psychologically more 
accessible to the subjects. 

Another example is the “compulsive” eat- 
ing symptom described by Ullman (1951). 
His experiment illustrates the fixation of an 
on-going response, and one need not postulate 
the highly complex motivational scheme such 
as Ullman develops in order to account for 
its occurrence. The literature on perseveration 
(Everall, 1935; Hamilton, 1916; Hamilton & 
Krechevsky, 1933) and on rigidity is rich in 
data supporting the principle that the re- 
sponse in progress at the time of frustration 
is highly susceptible to fixation. 
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Unlearned Preferences 


Personal or species preferences, even when 
unlearned, constitute another factor related to 
availability. Animals may have preferences 
for brightness, color, position, etc. when pre- 
sented with discrimination choices, and it 
may be assumed that such preferences will 
influence the response selected during frus- 
tration. 

An experiment by Aebli (1952) supports 
this factor. Using a large cross maze, un- 
learned preferences for left- or right-hand 
turns were determined in 11 rats. With the 
aid of a differential delay (60 sec. vs. 5 sec.), 
6 animals were trained in the direction op- 
posite their initial preference, while 5 were 
trained in the direction of their initial pref- 
erence. After this training, shock was adminis- 
tered at the choice point. Five of the six ani- 
mals trained on the opposite side of their 
initial preference regressed to their initial 
preference, whereas four out of the five 
trained in accordance with their initial pref- 
erence persisted in that response. When a re- 
learning attempt was made with the animals 
that regressed to their initial preference it 
was found that these animals were fixated 
and did not relearn a response that was op- 
posite to their natural preference. This ex- 
periment suggests that prior preferences in 
animals act as strong determiners of behav- 
ior under stress conditions and tend to make 
certain behaviors more accessible than others. 
Simplicity of Response 

A simple response is more likely to become 
fixated, other things being equal, than a com- 
plex or involved one. In the Michigan experi- 
ments (Maier, 1949), it was the consistent 
finding that rats fixated position responses 
more often than discrimination responses. Ac- 
cording to this factor it follows that an act of 
aggression is more likely to be a gross or 
primitive type of movement than a fine skill. 
As a corollary to this hypothesis it would be 
expected that complex activities should be 
more susceptible to stress variables than sim- 
ple activities; and they should reflect this in- 
creased susceptibility both in terms of differ- 
ences in rates of acquisition and in a more 
rapid deterioration under stress. 

With this frame of reference, the material 
on the influence of drive level on the acqui- 
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sition of simple and complex activities can be 
considered in a different manner, and some of 
the contradictions in the data can be resolved. 
It will be recalled that Taylor (1951) had 
postulated that anxious Ss operate at a higher 
drive level than nonanxious Ss, and since re- 
sponse strength is a multiplicative function of 
habit strength and drive, high anxious Ss 
should learn more rapidly than low anxious 
Ss. This was confirmed for a simple task, such 
as a conditioned eyelid response. However, 
Montague (1953) showed that anxiety actu- 
ally interfered with verbal learning (a more 
complex task). As a result of this finding 
Taylor and Spence (1952) modified the ear- 
lier theory in order to take into account the 
complexity of the task and postulated that 
higher drive states increase the number of 
competing responses that will interfere with 
the correct response in a complex problem. 
More recently though, Saltz and Hoehn (1957) 
demonstrated that when materials in which 
there are competing and noncompeting re- 
sponse tendencies are equated for difficulty, 
the Taylor-Spence prediction was not sub- 
stantiated. Rather, the data pointed to the 
likelihood that task difficulty rather than the 
operation of competing response tendencies 
was the more important variable. This find- 
ing of Saltz and Hoehn is entirely in accord 
with the expectations of frustration theory 
that make a complex or difficult task more 
susceptible to the influence of stress than a 
simple task. Thus, there is no necessity for 
postulating complex response interference 
processes, such as Taylor and Spence (1952) 
had done, to account for the differential ef- 
fects anxiety (if one treats anxiety 
a stress variable) on simple and complex 
learning. 

Finally, the previously cited paper by 
Hammes (1956) also may provide evidence 
for this point of view. On the easy task, vary- 
ing shock intensity causes no significant dif- 
ferences on the acquisition of the response, 
whereas on the difficult task high shock re- 
quired significantly more trials for learning, 
and significantly more errors occurred than 
for the low shock conditions 
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preference to a new one if other things are 
equal. However, this tendency is not as strong 
as is usually supposed, and is off-set by the 
greater importance of the response in prog- 
ress and the ease of movement. Nevertheless, 
it must be included as a factor making for 
response availability during frustration. Ac- 
cording to this principle, a trained boxer is 
more likely to hit with a skilled jab than 
with a haymaker when engaged in a barroom 
brawl, while a wrestler in the same situation 
would be more inclined to select a haymaker. 

This factor perhaps would not be crucial 
for testing frustration theory because learn- 
ing is regarded as an important selector of 
behavior in most theories. Frustration theory 
makes learning a less important factor, how- 
ever, and in this respect it might become an 
issue for a critical experiment. 


Sociological and Cultural Influences 


Although cultural influences are learned, 
the effect of culture is somewhat more com- 
plex than that of learning. One important 
complication is that social pressure operates 
to train and to motivate a social individual 
to follow the behavior pattern of his group. 
Although research in this important area is 


sketchy and inconclusive it should be ex- 
plored because of its potential theoretical im- 
portance. 

According to this factor various cultural 
groups should express their frustrations differ- 
ently. When frustration occurs, males should 
be more likely to show aggression than fe- 
males in certain cultures but not in others— 
depending upon the special values of the cul- 
ture. It also follows that the proportion of 
physical fighting to verbal attacks in play- 
grounds should vary in different social groups, 
being greatest in groups where a given form 
of aggression is most acceptable. The objects 
selected for attack as well as the mode of at- 
tack likewise will be influenced by cultural 
factors. Thus scapegoats for attack may be 
Negroes, Mexicans, Japanese, Irish, Jews, etc. 
depending on locality or cultural group in 
which the frustration occurs. This cultural in- 
‘fluence would supplement the factor of near- 
ness. 

The research of Miller and Swanson (in 
press) supplies many illustrations of the man 
ner in which middle- and working-class groups 
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respond to stress. Because of the cultural dif- 
ferences between these two classes they rea- 
soned that working-class males should be 
more inclined to express themselves by us- 
ing their skeletal muscles, while middle-class 
males should be more inclined to utilize con- 
ceptual modes. Elton McNeil, a member of 
the project, obtained experimental verification 
for this hypothesis, using matched groups of 
boys from each of the two classes as subjects. 
In a series of experiments reported in this 
volume many class differences were obtained, 
the behaviors tested ranging from levels of 
aspiration to expressions of aggression. 

One of the differences, which was primarily 
a function of class rather than child-rearing 
practices, was found when aggression and 
conscience were in conflict. Middle-class boys 
develop defenses that affect the control of 
aggression if made anxious about aggressive 
tendencies. These defenses take the form of 
reversal of feeling, turning on the self, and 
distortions regarding the attraction of for- 
bidden acts. Working-class boys, however, are 
not inclined to develop defenses against ag- 
gression and seem less concerned with its 
control. 

When no anxiety against aggression is in- 
troduced into the situation, working-class boys 
express their anger in the form of physical at- 
tack, whereas middle-class boys tend to en- 
gage in verbal argument or some form of con- 
ceptual aggression. In this instance, child- 
rearing practices are relevant. Working-class 
mothers use corporal punishment to deter 
their sons from fighting, who in turn use and 
advocate direct aggression. They learn the op- 
posite of what their training is intended to 
accomplish. Middle-class mothers use psycho- 
logical discipline, and their sons in turn fol- 
low and advocate a similar pattern of disci- 
pline. 

Miller and Swanson regard the pattern of 
home discipline to be one of the distinguish- 
ing features between these two classes, and 
they believe that learning plays a predomi- 
nant influence in determining the obtained 
differences. However, it can also be concluded 
that this early training establishes values and 
attitudes which, in turn, may inhibit the ex- 
pression of certain behavioral modes and con- 
sequently make others more available to the 
child. It is clear that these early learnings are 
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not specific in that the child is taught to be- 
have in a certain manner; rather he acquires 
attitudes and values from his background and 
these select the behavior. 

The Miller-Swanson studies include experi- 
mental data based on projective tests as well 
as observational data. For the further devel- 
opment of frustration theory it would be de- 
sirable to separate expressions of true frustra- 
tions from those revealed in test situations. 

Ecological, class, and cultural differences in 
the incidence of various kinds of behavior 
pathology also may be explained by this cul- 
tural factor. Rennie and Stole (1956) find 
that various kinds of psychosomatic disorders, 
such as asthma, hay fever, arthritis, heart 
conditions, high blood pressure, etc., differ 
considerably in their distribution along a 
socioeconomic status range. Thus, hyperten- 
sion, arthritis, neuralgia-sciatica increase in 
prevalence with progressively lower socioeco- 
nomic status, whereas colitis, hives-rash, and 
hay fever increase in prevalence with higher 
socioeconomic status. Apparently there are 
factors in different socioeconomic levels that 
predispose individuals to particular psycho- 
somatic symptoms. That this predisposing 
factor is not a motivational one is suggested 
by the fact that no relation between tension- 
anxiety and socioeconomic level was obtained. 
In a similar vein, Odegaard (1956) reports 
that various kinds of occupations predispose 
individuals to particular behavior pathologies. 
The general conclusion therefore may be 
drawn that the symptomatology displayed by 
emotionally disturbed peoples varies with 
class, sex, and socioeconomic status. 


Sex, Body Structure, and Personality 


Sex differences and variations in body build 
also may be expected to influence the avail- 
ability of responses. It is well known that an 
unhappy home life causes boys and girls to 
express their frustrations differently. Although 
part of these differences may be due to train- 
ing or cultural influences, it is best to keep 
this category separate from others until such 
related factors are found to be fully over- 
lapping. 

One relevant experiment related to this fac- 
tor is that of Marquart (1948). She observed 
men to be more likely to show hostility (ag 
gression) in her frustration experiments than 


205 


women, while women were more inclined to 
cry (regression) than men. 

The influence of body structure could best 
be investigated by researchers with different 
animal forms. It will readily be conceded that 
cats, deer, rats, chickens, pigs, etc. respond 
differently to punishment, capture, and at- 
tack, but no comparative studies have been 
made to formulate principles. It also may be 
supposed that a man’s size, strength, and 
physical handicaps will influence his behavior 
during frustration, even after his training and 
culture influences have been discounted. 

The suggestion by Jenkins (1955) con- 
cerning the influence of the kind of muscula- 
ture and degree of physical vigor on the na- 
ture of maladaptive delinquent behavior is 
relevant here. In those children who have 
good musculature and a high level of physi- 
cal vigor, directed aggressive attacks may be 
the child’s way of contacting the world. In 
those weaker and less well equipped for such 
behavior, a “screaming loss of control” with 
a hostile resentful overdependence may result. 
In this instance the prognosis is towards psy- 
chotic disorganization, whereas in the aggres- 
sive type the end result is usually the aggres- 
sive psychopath. 

Although culture and training overlap with 
conceptions of personality, it should be listed 
as a separate factor. Personality may deter- 
mine whether the first symptom of frustra- 
tion will be aggression or regression. Mar- 
quart’s (1948) study indicated that extro- 
verts were inclined to show aggression, whereas 
socially dependent individuals were inclined 
to show regression when frustrated. More re- 
search is needed to clarify this factor. 


Summary 


The present paper has dealt with the three 
major explanatory concepts of frustration 
theory: the frustration threshold, the qualita- 
tive distinction between frustration-instigated 
behavior and motivated behavior, and the 
principle of availability. Mustrative data from 
the literature of various research areas were 
analyzed from the point of view of the theory 
to demonstrate how its concepts could be uti- 
lized in explaining and integrating these di- 
verse kinds of data. In addition, an attempt 
was made to determine whether these con 
cepts could clarify research areas that were 
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confused by contradictory data. This was 
done by attempting to integrate the contra- 
dictory data within the framework of the 
theory and also by suggesting questions that 
might be subject to empirical verification. 
The factors that determine the form of ex- 
pression that frustration will take and the 
types of behavior pathology that may appear 
were examined. It is clear that the nature of 
the provoking conditions, the types of needs 
that are denied, and the intensity of need 
deprivation are insufficient variables to ac- 
count for the findings. Research in this area 
is badly needed and it is hoped that the issues 
raised will suggest additional problems to ex- 
plore and new categories of data to tabulate. 
Although the present elaboration of the con- 
cepts of frustration theory led to an explana- 
tion and integration of material from a va- 
riety of sources, there is no intent to convey 
the impression that frustration theory is a 
completed system. Many details and relations 
need to be extended and clarified. Since one 
of the requirements of a meaningful behavior 
theory is that it be helpful in generating test- 
able hypotheses and concepts, it is hoped that 
in pointing up crucial issues in a wide range 
cf data, differences in theoretical positions 


can be subjected to experimental investigation 
and hence to a further elaboration of the the- 
ory. A prematurely closed theory may be a 
handicap to new research because it delimits 
the regions explored. What is needed is the 
location of new areas. 


Received April 1, 1958 
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INDEPENDENCE TRAINING ATTITUDES, AND 
HANDICAPPED CHILDREN’S 
PERFORMANCE 
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The research reported here was designed to 
test three related hypotheses concerning the 
variables influencing the performance of hear- 
ing handicapped children. 

The particular performance in which we 
were interested may be described as the dis- 
crepancy between a child’s intellectual abil- 
ity, as measured by the Merrill-Palmer, and 
the extent to which he has accomplished cer- 
tain developmental tasks which contribute to 
his independence from home and parents, as 
measured by the Vineland Social Maturity 
Scale. Rehabilitation workers are interested 
in the variables which influence the extent to 
which handicapped children make maximal 
use of their resources. The Merrill-Palmer 
Vineland discrepancy (MP-V) seems to be a 
reasonable measure of this ability-perform 
ance relationship. 

The three sets of variables whose relation- 
ships to MP-V were studied were: (a) ma- 
ternal independence training attitudes toward 
the deaf child; (%) selectivity in such atti- 
tudes on the basis of the hearing handicap; 
and (c) mothers’ achievement needs. 

McClelland, Atkinson, Clark, and Lowell 
(1953) have presented evidence from Winter- 
bottom (1953) demonstrating that achieve- 
ment motivation in boys is related to the in- 
dependence training attitudes of their moth 
ers. It appears reasonable that such maternal 
attitudes might also be related to MP-V per- 
formance in handicapped children, on the as 
sumption that MP-V reflects, to some extent, 
the children’s drive to achieve, as well as their 
tendencies to become independent. Although 
Winterbottom studied the relationship be 
tween independence training attitudes and n 


Achievement only in boys, adequate evidence 
for sex differences in this relationship does 
not exist. While mean level of independence 
training attitudes may differ on the basis of 
the sex of the child, and MP-V may also show 
Doll did not find 
them in his standardization of the Vineland), 
there is no reason to suppose that the relation- 
ship between the variables should differ as a 


sex differences (although 


function of sex, particularly if independence 
training attitudes represent an antecedent 
condition for the behavior being investigated 
Therefore the present research uses deaf chil 
dren regardless of sex 

A major problem in Winterbottom’s study 
is the retrospective nature of the mothers’ re- 
sponses to the independence training question- 
naire. One might well argue that, rather than 
early independence training being a causative 
element in the production of m Achievement, 
the situation might be reversed. That is, the 
mothers of high m Achievers may have re 
sponded to the questionnaire by reference to 
the ages at which their children accomplished 
the developmental tasks which constitute the 
items. It that high 


may be Achievement 


children spontaneously “demanded” independ 


and in this influenced the 


mothers’ retrospective age estimates. The re 


ence early way 
search reported here tends to minimize this 
problem through the use of children who are 
too young to have accomplished most of the 
developmental tasks listed in the question 
naire. Mothers’ responses are therefore less 
influenced by past experience with their chil 
dren. To the extent that this is so. a 
measure of attitude is obtained 

The second hypothesis studied here was the 


purer 
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effect of selectivity in mothers’ attitudes on 
MP-V performance. Where mothers’ inde- 
pendence training attitudes toward their deaf 
children differ from their attitudes toward 
their normal hearing children, it may be ex- 
pected that the deaf children’s performance 
will be affected. 

To test the first hypothesis of a relation- 
ship between independence training attitudes 
and MP-V, the portion of Winterbottom’s 
questionnaire which was published by Mc- 
Clelland was given to a group of mothers 
with a set to respond with reference to their 
hearing handicapped children. The portion 
used excluded the “caretaker” items (Items 
9, 12, 14, and 17) which were found to be 
unrelated to achievement motivation in, boys. 
To test the second hypothesis, the same ques- 
tionnaire was again administered to the moth- 
ers, but this time with a set to respond with 
reference to their normal hearing children. 

Our third hypothesis relates to the ante- 
cedents of intependence training attitudes in 
the mothers’ personality configurations. Mc- 
Clelland has explicated the broad cultural an- 
tecedents of independence training attitudes 
as they are related to Protestantism. The 
question remains of how these cultural fac- 
tors operate within the individual. It was hy- 
pothesized that one such personality charac- 
teristic in mothers related to her independence 
training attitudes is her own achievement mo- 
tivation. In addition, the relationship between 
such motivation and discrepant attitudes to- 
ward deaf and normal hearing children was 
also studied, under the expectation that the 
presence of a handicap in a child would 
have particularly great meaning to a high n 
Achievement mother. Where the meaning of 
the handicap is great, it is to be expected that 
greater discriminations will be made between 
handicapped and nonhandicapped children. 

Mothers’ Achievement scores were ob- 
tained from stories told to TAT cards under 
the standard conditions described by Mc- 
Clelland, except that six TAT cards were 
used, all of which were different from those 
used by McClelland. The cards used were 1, 2, 
4, 6GF, 7GF, and 8GF. McClelland presents 
evidence that although mean scores on 
Achievement vary with the stimuli used, peo- 
ple nevertheless retain their relative ranks 


Gordon 


regardless of the stimuli. This suggests that 
the use of different stimuli does not invalidate 
the m Achievement scores obtained. 


Method 


The research was carried out at a two-week 
institute for mothers and their deaf preschool 
children, sponsored by the Pennsylvania So- 
ciety for Crippled Children and Adults, Inc. 
The Institute is an annual speech and hear- 
ing program conducted at the Society’s Har- 
mony Hall, at Middleton, Pennsylvania. 

Subjects (Ss) were 18 mothers attending 
the 1957 institute, and their preschool deaf 
children, and one grandmother who had com- 
plete charge of her deaf granddaughter. Since 
the program is largely supported by charity 
agencies, and the nominal fee is waived where 
there is inability to pay, the program is not 
selective on the basis of socioeconomic level. 
All mothers present had at least one other 
child who had normal hearing. 

The children ranged from 2.5 to 6.0 years. 
There were 11 boys and 8 girls. Cause of 
deafness varied from unknown through con- 
genital injury and injury consequent to a 
childhood disease. 

The nm Achievement measurement proce- 
dures were administered to the mothers in 
small groups. Each S$ was given a booklet of 
six pages, on each of which were four general 
sets of questions relating to the TAT picture 
stimuli, with space under each set for S to 
write her answers. E showed the stimuli, one 
at a time, to the groups for 20 seconds. After 
the exposure of the picture, Ss were given 
one minute to write their responses in the 
booklet to each set of questions. These pro- 
cedures are explained in greater detail else- 
where (McClelland et al., 1953). For one § 
who could not write, E recorded her stories 
as dictated. 

The stories were scored for n Achievement 
by E. The validity of his scoring may be esti- 
mated from his scoring of the four-story rec- 
ords of 30 cases published by McClelland; 
the correlation between E’s scoring of these 
stories and the scores published in the ap- 
pendix of McClelland’s book was r = .85. E’s 
rescoring of the mothers’ stories two weeks 


ifter his initial scoring was correlated with 
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his initial scoring with r = .90, thus permit- 
ting an inference of adequate reliability in E’s 
scoring. 

The Vineland Social Maturity Scale was 
administered to each mother individually. 

An attempt was made to test each child on 
the Merrill-Palmer scale. However, it was 
not possible to obtain scores on five children, 
through lack of cooperation. Thus the W is 
reduced to 14 for those analyses involving 
MP-V. 

The independence training questionnaires 
were administered to the mothers in groups. 
The questionnaires were unlabeled; they were 
introduced as a means of finding out what 
mothers “on the firing line” expect of their 
children. At the first testing, the mothers were 
instructed to answer the items with respect 
to their deaf children. At the second testing 
session, mothers were requested to answer in 
terms of their normal hearing children. The 
independence training testing departed from 
Winterbottom’s procedures in one respect. In- 
stead of asking mothers to check those items 
which they expected their children to accom- 
plish by the age of 10 years and then asking 
them to fill in the expected age for each 
checked item, mothers were simply instructed 
to indicate an age for each item. 


Results 


Independence Training Attitudes and MP- 
V Performance. In every case in which a 
Merrill-Palmér score was obtained, it was 
higher than the Social Quotient derived from 
the Vineland, as is to be expected from handi- 
capped children. No significant differences 
were found in the independence training atti- 
tudes toward deaf children between the moth- 
ers of children categorized as high on MP-V 
discrepancies and those of children classified 
as low (Table 1, Line 1). When the children 
were categorized in such a way that there 
were the same number of boys and girls in the 
high and low groups, in order to control for 
possible sex bias in the data,’ the differences 


1 This matching was performed by assigning the 
higher scoring half of the girls to the “high” group 
and the lower scoring half to the “low” group, and 
then doing the same for the boys. This procedure 
balances the groups for sex, and provides a more 
tringent test of the 


hypothesis, since there is no 


Table 1 


Relationships Between Children’s MP-V Performances 
and Maternal Independence Training Attitudes 


Children Categorized on 
the Basis of MP-V 
Discrepancies 
Mean Scores:of 
Mothers on: 


High Low # Ratio 


1. Maternalindependence 7.6% 9./ 
training attitudes 
toward deaf child 


2. Maternal independence 
training attitudes 
toward normal child 


3. Discrepancies between 
independence training 
attitudes toward deaf 

hil 
and norma! children 


* Italicized figures are derived from analyses of sex-matched 
groups; nonitalicized figures are derived fron 
not so nm 


so matchec 


analyses of groups 


in maternal independence training attitudes 
toward deaf children remained nonsignificant 

However, in analyses of independence train- 
ing attitudes toward normal children (Table 1, 
Line 2), it was found that the mothers of 
high MP-V discrepancy children favored ear- 
lier independence than did the mothers of 
low MP-V discrepancy children. This finding 
tended to hold up in an analysis in which the 
high and low MP-V groups were matched in 
terms of numbers of boys and girls in each 
group. It should be pointed out that this rep 
resents a very conservative test, because the 
groups have been matched without a com 
parable reduction in the error term. 

The discrepancies between the independ 
ence training attitudes toward chil- 
dren and toward deaf children found 
not to be related to the MP-V performance 
of the children (Table 1 

Mothers’ Achievement Needs and Indé 
pendence Training Attitudes. The n Achieve 
ment scores of mothers favoring early inde 


normal 


were 


Line 3) 


pendence in normal children were not sig 
nificantly different from the scores of those 


way in which the error term can be 


fact that the 


reduced to take 
into consideration the groups have beet 


matched 
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favoring later independence, when the groups 
are matched in terms of number of male and 
female children (Table 2, Line 1). However, 
a plot of the data very clearly indicates a 
curvilinear relationship between these two 
variables. All 19 mothers were ranked on 
their independence training attitudes toward 
normal children with Rank 1 assigned to the 
mother with the earliest mean age on the in- 
dependence training questionnaire, and then 
on n Achievement, with Rank 1 assigned to 
the mother with the lowest score. When the 
ranks on the two variables are compared, it 
is found that among the mothers ranked from 
6 to 15 on independence training are found 
all but one who ranked below 10 on n 
Achievement. There is no appropriate sta- 
tistic to describe this relationship where the 
N is so small. However, the data do suggest 
that mothers with low achievement motiva- 
tion tend to be more moderate in their in- 
dependence training attitudes toward normal 
children than mothers with high achievement 
needs. 

When the mothers are grouped into early 
and late independence training attitude groups 
on the basis of their attitudes toward deaf 
children, and these groups are equated for 
number of male and female children, it is 


Table 2 


Relationships Between Mothers’ m Achievement a1 
Independence Training Attitudes 


n Achievement Scores of 
Mothers Categorized as 
High and Low in Inde 


pendence Training Attitudes 


Mothers 
Categorized on: 


High Low 1t Ratio 


1. Independence training 
attitudes toward 
normal child 

2. Independence training 

attitudes toward 

leaf child 


3. Discrepancies between 
attitudes toward deaf 
and normal children 


* Italicized figures ar 
t nitalicized figures 


atched 
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found that the m Achievement scores of the 
mothers favoring late independence are sig- 
nificantly higher than those of mothers fa- 
voring early independence (Table 2, Line 2). 
The mothers were grouped according to the 
size of the discrepancies between their inde- 
pendence training attitudes toward deaf and 
toward normal children and the groups 
equated for number of male and female chil- 
dren in each. No significant differences in n 
\chievement scores were found between the 
mothers so grouped (Table 2, Line 3). 


Discussion 


Our results do not support the hypothesis 
that independence training attitudes toward 
deaf children are associated with the extent 
to which the social development of deaf chil- 
dren approaches the limits of their ability. 
However, independence training attitudes to- 
ward normal children were found to be asso- 
ciated with this variable. It may be that the 
measurement of attitudes under a “normal 
child” set provides a more valid estimate of 
independence training attitudes than does 
testing under a “deaf child” set, in that the 
responses of the mothers in the former situa 
tion are relatively uncontaminated by par- 
ticular attitudes toward hearing handicaps 
Our data suggest that in some indirect man- 
ner these attitudes toward normal children 
affect the behavior of the deaf children. It is 
to be noted that the direction of the relation- 
ship between children’s behavior and the in- 
dependence training attitudes is opposite to 
what was expected on the basis of Winter- 
bottom’s findings. A possible explanation for 
this may be that as a mother expects more 
and more from her normal hearing child, the 
deaf child stands in greater contrast to the 
normal sibling. Such contrast might operate 
on the deaf child by robbing him of the in- 
centive to accomplish the developmental tasks, 
which compose the Vineland, through frustra- 
tion and the inability to compete with the 
sibling. Thus discrepancies between the deaf 
child’s performance and his ability develop 

An alternative explanation may be that the 
mother who encourages early independence in 
hearing child is free to devote more of 
to the 


her 


her interest and nurturance motives 
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handicapped child. The increased interest may 
take the form of solicitousness, which would 
tend to reduce the opportunity and/or need 
for the deaf child to develop the kind of in- 
dependence measured by the Vineland. 

Rehabilitation workers sometimes take the 
view that an improvement in significant ma- 
ternal attitudes toward the handicapped child, 
and thus ultimately improvement in the child’s 
behavior, is contingent upon a reduction of 
emotionalized responses to the child and his 
handicap. Our data suggest, on the other 
hand, that the more important influences on 
the handicapped child are not the maternal 
attitudes toward the handicap but, rather, to- 
ward children in general. 

The curvilinear relationship between achieve- 
ment motivation in mothers and independence 
training attitudes toward normal children is 
an interesting one. The relationship indicates 
that highly motivated mothers expect inde- 
pendence either very early or very late. This 
may that achievement motivation 
may interact with response dispositions as in 
Hullian drive theory to intensify response 
strength; thus, high drive mothers are found 
at the extremes of the distribution in inde- 
pendence training attitudes toward 
children. 

However, this kind of relationship between 
motive and response is not found where the 
directed toward deaf children. 
Here achievement motivation is clearly asso- 
ciated with the failure to encourage early in- 
dependence. It may be that the occurrence 
of a handicap in the family operates to focus 
maternal achievement needs, such that high 
n Achievement mothers perceive the handi- 
cap as a challenge. The overprotective re 
sponse implied in the late independence train 
ing attitudes of high m Achievement mothers 
may be of such a nature that reduction of the 
drive to meet the challenge occurs, thus re- 
inforcing protective attitudes. The increasing 
independence of a deaf child, on the other 
hand, may be perceived as a threat to the 
mother who views the handicap as a chal- 
lenge which she must meet. Thus the encour- 
agement of early independence in a deaf child 
would not be reinforced. Perhaps it is for rea- 
sons such as these that with reference to in- 
dependence training attitudes toward a deaf 


suggest 


normal 


response is 


child, high achievement motivation operates 
unidirectionally, rather than simply by in- 
tensifying early training or late training re- 
sponse dispositions, as was the case with atti- 
tudes toward normal children. 

To summarize, the over-all picture suggests 
that high » Achievement mothers tend to 
overprotect their deaf child, or to wish to, 
but they may go to either extreme with their 
normal children. If they go to the extreme of 
favoring relatively early independence in nor- 
mal children, the result may be a tendency 
for the deaf child to develop independence 
at a slower pace than his capacities would 
suggest. 


Summary 


This research was designed to test three 
hypotheses concerning the behavior of heat 
ing handicapped children: (a) The extent to 
which a deaf child’s social maturity level ap- 
proaches the limits of his ability is related to 
the independence training attitudes of the 
child’s mother; (b) The extent to which so- 
cial maturity levels of deaf children approach 
their ability levels is related to the extent to 
which mothers’ training atti 
tudes toward deaf children differ from their 
attitudes toward normal children; and (c) 
Maternal independence training attitudes are 
associated with mothers’ 
tion. 

Ss were 19 mothers and their deaf preschool 
children. Six TAT cards were administered to 
the mothers, following McClelland’s standard 
instructions, and their scored for n 
Achievement according to McClelland’s cri 
teria. Mothers were also administered part of 
Winterbottom’s Independence Training Ques 


independence 


achievement motiva- 


stories 


tionnaire, once with the set to respond with 
reference to their deaf children, and once with 
a set to respond with reference to their not 
mal hearing children 

Social maturity relative to intellectual abil 
ity was measured in the deaf children by the 
discrepancy between Merrill-Palmer and Vine 
land Social Maturity Scale scores 

The major results were as follows: 

1. Attitudes favoring early independence in 
normal children were found in the mothers of 
deaf children who showed relatively large 
Merrill-Palmer discrepancies 
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2. Independence training attitudes toward 
deaf children, and discrepancies between atti- 
tudes toward deaf and normal children were 
not associated with Merrill-Palmer—Vineland 
discrepancies. 

3. Mothers 


with low achievement needs 


tended to be moderate in their independence 
training attitudes toward normal children, 
while high m Achievement mothers tended to- 
ward the extreme positions of favoring very 
early or very late independence. 


Gordon 


4. High m Achievement mothers favored 
significantly later independence in deaf chil- 
dren than did low m Achievement mothers. 
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Psychologists have long been concerned 
with various aspects of the ability of people 
to judge others (Taft, 1955). Studies based 
on peer, co-worker, or buddy ratings, i.e., rat- 
ings of an individual by other members of his 
group, have been summarized, in part, by 
Hollander (1954a). The method rests on the 
assumption that peers, by virtue of their close 
association with one another, have oppor- 
tunity to acquire a global fund of information 
about each other and that this information 
can be sampled by appropriate means. 

Webb studied the reliability and validity 
(1955) and methodology (1956) of peer rat- 
ings. Wherry and Fryer (1949) found that 
buddy ratings were reliable and identified 
leadership potential among army officer can- 
didates much earlier than did tactical officers 
and more accurately than did academic in- 
structors. 

Hollander (1956b) studied the length of 
time it took naval officer candidates to be- 


1 We are deeply indebted to the patients, psychol- 
ogy trainees, and staff of the Ann Arbor VA Hos- 
pital Psychiatric Service who so generously gave 
their time and cooperation. This study was carried 
out between June, 1954 and August, 1956. E. Lowell 
Kelly of the University of Michigan was most help- 
ful in reviewing the statistical analysis and reading 
the manuscript. 

2A preliminary draft of this article was presented 
during the VA Day Program, American Psychologi- 
cal Association, Chicago, 1956. 


come well enough acquainted with each other 
before they could make valid inferences about 
future performance. Peer ratings made dur- 
ing orientation week predicted instructors’ 
final (16th week) military aptitude grades. 
Willemin and (1957) observed 
that mental ability was not related to the abil- 
ity to judge fellow soldiers among advanced 
infantry trainees. 

In a study on morale, Webb and Hollander 
(1956) found peer ratings superior to both 
self-evaluations and to a survey technique. 
Willemin, Rosenberg, and White (1957) 
found that buddy ratings predicted the six 
areas (group loyalty, dependability, knowl- 
edge of the combat task, performance under 
stress, aggressiveness, and initiative) of the 
Combat Aptitude Scale better than did pre- 


Rosenberg 


dictions based on personality, reasoning, per- 
ceptual speed, perception under distracting 
conditions, psychomotor, and Army Classifi- 
cation tests. 


Thus, peer ratings have formed the basis 
for valid predictions regarding estimates of in- 
telligence (Webb, 1955), morale (Webb et al., 
1956), leadership (Wherry et al., 1949), suc- 
cess in cadet training (Hollander: 
1954a, 1954b, 1956a), performance in medi- 


aviation 


cal school (Kelly, 1957), and army combat 
effectiveness (Willemin, Birnbaum, & Rosen- 
berg, 1957). 
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Peer ratings have not been applied to the 
many problems of prediction and evaluation 
as related to mental patients. This study 
adapts the method of peer ratings to the 
study of prognosis in such patients. The pur- 
pose of this study was to investigate whether 
a group of open ward psychiatric patients 
from a VA general medical and surgical hos 
pital could predict, by means of peer ratings 
their own and each other’s adjustment in 
four specific areas during the two-year pe- 
riod following their discharge from the hos- 
pital. The treatment staff also rated these 
patients by following the identical procedure 
which the patients used. 


Method and Results 


Predictions of the prospect of rehospitali- 
zation, and the post-hospital work, family 
and health adjustment of all patients on the 
ward were made once each month for six 
months by every patient and staff member. 
Each S was individually interviewed and 
asked to check Yes, No, or Cannot Say after 
each patient’s name for each of the following 
predictor questions. Each patient also rated 
himself. 


1. Do you believe that this man will have to be 
hospitalized again for a neuropsychiatric condition 
within a period of two years following discharge? 

2. Do you believe that this man will work steadily 
for the next two years after he leaves the hospital ? 

3. Do you believe that this man will have serious 
family trouble within the two-year period following 
discharge ? 

4. Do you believe that this man will enjoy good 
physical and mental health for the two years fol 
lowing discharge from the hospital? 


The staff of 21 included: a staff psychia- 
trist; five psychiatric residents; three each of 
aides and nurses; two each of occupational 
therapists, recreation therapists, social work- 
ers, and psychologists; and a ward secretary. 

Of the 36 patients, approximately 40’ 
were neurotic, 20% schizophrenic, 25% had 
psychophysiologic reactions, and 15% were 
character disorders. Their median age wes 
31.5 years. Although patients were discharged 
from the hospital at varying intervals, each 
patient was included in three monthly sur- 
veys, on the average. 

After two years, follow-up data were col- 
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lected on all 36 patients. Of the 26 patients 
still residing in the state, 24 were studied a 
the hospital by a staff interviewer and a sta‘f 
observer. One patient was seen by a prison 
psychiatrist and psychologist, who forwarded 
the necessary data, and the other was visited 
at his home by a Red Cross field worker. 
Complete data on the remaining 10 patients 
were obtained through the cooperation of the 
Red the VA, and the Army, and 
through correspondence with the patients or 
their relatives. 

The post-hospital data were studied in 
erms of the following criteria. Each criterion 
was dichotomized, paralleling the form of the 
predictor questions. 

Rehospitalization. Any inpatient hospitali- 
zation on any psychiatric ward during the 
two-year post-hospital period. 

Work adjustment. A work index was de- 
vised to evaluate a patient’s vocational ad- 
justment: 


Cross, 


time employei , duration of longest jol 


since discharge held since discharge 


Work ir : 

total time since discharge 
The work index value was doubled if the pa- 
tient was employed and working at the time 
of the follow-up examination. The arbitrary 
weights of the variables comprising this work 
index yielded values which ranged from 0. 
to 4.0. A value of 3.0 or greater 
in advance as the criterion for satisfactory 
work adjustment. For example, a patient was 
judged to be making a satisfactory work ad- 
justment if he was currently employed and 
had held one job at least 75% or more of the 
time since hospital discharge, or a patient 
who had held two jobs consecutively and had 
worked at them full time without any period 
of unemployment, etc. using 
their own standards, dichotomized the post- 
hospital work history data independently and 
agreed with the categorization derived from 
the work index in 30 of (83.3%) 
The work index was used as the sole criterion 
of work adjustment in computing correlations 
which appear later in this study. 

Family adjustment. In order to meet the 
criterion of satisfactory family adjustment, 
the patient had to have a history free of the 
following since leaving the hospital 


was set 


Two judges, 


36 cases 


deser- 
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tion, long separation, divorce, prolonged ex- 
tramarital affairs, rejection of an acceptable 
family home, or acting out behavior (alcohol- 
ism, criminal or sexual assault) directly at- 
tributable to family conflict. Using this defi- 
nition, two independent raters agreed on 30 
(83.3%). The remaining differ- 
ences of opinion were discussed and recon- 


of 36 cases 
ciled by the raters. 

Health adjustment. A patient was defined 
as having good general health if any symp- 
that he had manifested was not suffi- 
ciently disabling so as to seriously interfere 


tom(s) 


with his over-all functioning as a citizen. Two 
independent judges agreed on 32 of 36 cases 
(88.9 The four cases on which opinions 
and the 


were reconciled by the raters. 


differed were discussed differences 


Two preliminary questions were asked of 
lata. What was the reliability of the rat- 


ngs of the naticni-peer group, and of the staff 
oup? How closely did the patients agree 
with the staff in making their predictions? 


patient was given a Yes or No desig- 


n each month as long as he remained in 


the study on each of the four prediction ques- 


tions. For example, a Yes for a patient dur- 


ing a particular month on the first question 
} 


the majority of t 


that 


(peers oO! staff ) 


meant 1e rating group 
the opinion that 


month that this patient would be rehospital- 


were of 


ized on a psychiatric ward within two years 
following his discharge from the hospital, etc 
The average of all the biserial correlation co 
efficients between adjacent pairs of monthly 
group ratings over the six months’ study pe- 
riod was .60 for 
the staff 


nincant at t I 


the patient-peers and .77 for 
Both of these correlations were sig- 
level, and the difference 

was also significant at the .01 
not too surprising that the staff 
] 


were more reliable than the patients’ 


level. It is 
ratings 
in view of the high rate of 


ratings turnover 


among the patients and the absence of per- 
staff. Biserial cor- 
relation coefficients computed each month for 
six months between the patients’ distributions 


ind the 


sonnel turnover among the 


staff's distributions ranged between 
» .82, all significant at the .01 level 

\ tabuJation of the showed that 

third or 13 of the 36 patients had 

excellent 


criteria 
about one 
made an 


adjustment in all four 


“ 


areas. About two thirds or 23 patients were 
making a satisfactory work adjustment, but 
two thirds had serious family trouble. One 
third or 12 patients had failed to make a 
satisfactory adjustment in all four areas: 
were rehospitalized, had not worked steadily, 
had had serious family trouble, and had not 
enjoyed good health. 

After each patient was evaluated with re- 
spect to the criteria, the main task of com- 
paring the predictors with the criteria fol 
lowed, for each of the two rater groups and 
for each of the four areas studied. First 
based on each of six monthly surveys 
one at a time, with the cri 
iverage ratings for each patient 


pre- 
diction 
were compared 
Next 


based on 


teria 
three to six monthly 


length of 


surveys, de 


pending on hospitalization, were 
ratings 
compared with the criteria. These averaged 
will be called ratings. Fi- 
nally, the last ratings which a patient was 
} 


computed, and these averaged were 


ratings combined 


given during the month before he was dis 


from the 
the criteria 


charged hospital 
with These last 
called predischarge ratings 


were compared 


ratings will be 

Chi square and Fisher’s Exact Method were 
used to screen the predictive efficiency of the 
monthly, combined, and predischarge rating 
distributions. This procedure eliminated the 
individual monthly peer and staff ratings as 
predictors of post-hospital adjustment since 
significant. An in 
cells revealed the 
interesting tendency for patients to err on the 


none of the p values are 


spection of chi squares for 


while the staff 
regarding the 


side of being overly optimistic 


pes imistic 


erred by being too 
anticipated adjustment of the patients. Com 
putations based on the chi square 
ealed that 


iverage 


‘predis 


charge” cell values re both pa 


tients and staff had ar accuracy of 


ys 
4\ in } 


predicting adjustment in all fow 
areas 
The mai ndings of this 


| ble 


the 16 correlation coefficients are sig- 


ud ire pre 


ented in vhere it will be seen that 


nificant at the .03 point. In nine instances 


the correlations are bevond the 
Ol point. Staff raters were able to predict 


post hospital 


significant 


signifi 
greater than chance in all four areas 
for all ex 


adjustment at a level 
cantly 


The patients predicted accurately 
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Table 1 


Relationships Between Majority Opinion Prediction Ratings 
Adjustment Criteria for Patient 


Adjustment Criteria 


I. Rehospitalization 


Work adjustmer 


bis 


O~ 


Family adjustment 


rr 


8 


Health adjust 


cept the area of health adjustment. Among 
the three areas of adjustment that both groups 
could predict, the staff was significantly more 
accurate (< .01) in predicting work adjust- 
ment than the patients, but the patients were 
more accurate in predicting family adjust- 
ment (< .05). 

Next, the predictive efficiency was evalu- 
ated for each patient regarding himself, each 
patient regarding other patients, each staff 
member as a rater, and each professional 
group represented on the staff. 

Patient self-predictions did not reach the 
.05 point for any of the four areas of adjust- 
ment. 

The predictions of only two to four pa- 
tients on any one area of adjustment reached 
the .05 point. No patient was able to predict 
adjustment in all four areas consistently. 

The most accurate predictors among indi- 
vidual staff raters included the ward secre- 
tary, an aide, a recreation worker, a iiurse, a 
psychiatric resident, and the two psycholo- 


| Corresponding Dichotomized Post-Hospital 
| for Staff Raters * 


Prediction Ratings 


gists. As far as individuals on the staff were 
concerned, ability to predict post-hospital ad- 
justment of patients was not significantly re 
lated to professional background and training 

\ll professional groups on the staff were 
ible to predict work adjustment, with the 
exception of the occupational therapists | 

7). The two psychologists reached the 
point of significance on all four areas. Social 
workers did less well than staff 
groups in predicting family adjustment, reach- 
ing a nonsignificant level of .14. Nurses, aides, 
resident psychiatrists, and recreation workers 
as groups, predicted significantly at beyond 
the .03 point on rehospitalization, work, 
adjustment, but each of these 
groups missed on health adjustment 

Usually a statement regarding prognosis is 
made by the resident in charge of the case at 
the time of the patient’s discharge. This con- 
dition was approximated statistically in this 
study by tabulating the predictions made by 
each resident for his own patients during the 


most other 


and 


staff 


family 
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patients’ last month of hospitalization. While 
none of the predictions made by the five resi- 
dents, as individual raters, reached statistical 
significance, each resident’s predictions were 
in the right direction. Since the number of 
patients per resident was small, these data 
were pooled. Pooled residents’ ratings made 
during the patients’ last month of hospitali- 
zation significantly predicted only one of the 
four areas, rehospitalization, at beyond the 
O1 point 

Other of the more usual prognostic vari- 
ables were compared with the criteria. For 
this sample, diagnosis, length of treatment at 
this hospital, and age bore no significant re- 
lationship to post-hospital adjustment. Num- 
ber of previous hospitalizations was a good 
predictor of rehospitalization (<.01) but was 
not a good predictor of work, family, or health 
adjustment. A rather unusual predictor was 
also evaluated. Biserial correlation coefficients 
were computed between weight of C-files * 
criteria measures 


and 
The only criterion which 
the C-files did not predict at the .001 point 
was family adjustment, and this they pre- 
dicted at the .05 point. The correlations 
ranged from .33 for family adjustment to .61 
for rehospitalization, with the mean correla- 


tion being .52 


Discussion 


Psychological tests, objective or projective, 
were not used in this study. Predictions were 
derived from human interactions. Judgments 
based on these interactions were obtained by 
asking for a Yes or No response from all of 
the people concerned. 

During the first month or two of this study, 
some of the patients had difficulty accepting 
the fact that their opinions and predictions 
were regarded as being worthwhile. Although 
no study was made of this feature, the im- 
pression was that the attitudes the patients 
had toward the staff and toward themselves 
might have become more positive as a result 
of participating in this study. 

The patient raters faced some sizeable ob- 


stacles. These included high rate of patient 


A C-file contains all the material on the veterans 
compensation claims and allowances, and VA mili 
tary hospital discharge summaries 


turnover and the inclusion of self-ratings, 
known in advance to possess little validity in 
this form, in the pool of patient ratings. Pa- 
tients did not have access to the detailed in- 
formation contained in previous and current 
hospital records, case histories, and test re- 
ports. 

The staff raters also faced some obstacles. 
Apparently there were sources and kinds of 
information which were available to the pa- 
tients but not to the staff. This is a problem 
area to be explored in its own right. 

Methodologically speaking, 
group, on any one monthly 
could make valid predictions. 


neither rater 
rating period, 
However, the 
predictions attained significance if one dis- 
tribution constructed of ratings made 
during each patient’s last month of hospitali- 
zation, or if all monthly surveys were com- 
bined into one distribution 

\ methodological point which needs ex- 
ploration is to investigate how much addi- 
tional criterion information the raters could 
profitably use. The questions that were asked 
were simple and general. For example, “Will 
this man have serious family trouble?’ The 
investigator could explain to one half of a fu- 
ture study population, “By serious family 
trouble we mean such things as this patient 


was 


deserting his family, having long separations 
from his wife, obtaining 


a divorce, running 
around with other women or beating his wife.’ 
The other half of the group could be asked 
the simpler question. 

It would be interesting to learn whether 
this general, rating by peers, approach could 
be applied in a psychiatric setting as it is 
, to collect data 
from a group of raters at one time, instead of 
individually. It is also interesting to specu 
late what might happen if the ward secretary 
or the patients, for example, through their 
Patient Council, were asked to collect data 
for this type of study. 


done in a military setting; i.e 


As will be recalled, the patient’s own self- 
predictions were unreliable. This was expected 
on the basis of other studies (Taft, 1955) in- 
volving self-ratings. Several unexpected events 
occurred, however. Various staff occupational 
groups were not able to predict the area(s) 
closest to their area of specialization, while 
their staff colleagues in other occupational 
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groups were able to make these predictions. 
For example, social workers missed in predict- 
ing family adjustment. Occupational thera- 
pists missed in predicting job adjustment. 
Resident psychiatrists missed in predicting 
job, family, and health adjustment on their 
own assigned patients. Nurses, aides, and 
resident psychiatrists missed on the predic- 
tion of health adjustment. This raises a very 
interesting and broad question for further 
study. Do people lose some of their objec- 
tivity when they move close to themselves 
or to their areas of professional competence? 


Summary 

Using a predischarge ratings by 
method, an open ward group of 36 psychi- 
atric patients were able to predict individual 
patient’s rehospitalization as well as their 
work, family, and health adjustment for 
period of two years following hospitalizatior 
with an average accuracy of 70%. The pa 
tients’ staff of 21 members were able to pre 
dict future adjustment in the same four areas 
with the same average accuracy of 70%. The 
patients were more accurate (< .05) in pre- 
dicting family adjustment, while the staff 
was more accurate (< .01) in 
work adjustment. A biserial cerrelation co- 
efficient of .84 was obtained between predis- 
charge patient predictions of family adjust 
ment and a two-year fellow-up criterion. A 
biserial r of .86 was obtained between predis 
charge staff predictions of work adjustment 
and a criterion. 

As individuals, no patient was able to pre 
dict his own future adjustment nor was any 
patient able to successfully predict all fou 
areas of adjustment for the other patients 

Ability to predict successfully among indi- 
vidual staff members or among the various 
professional subgroups was not related to pro- 
fessional specialization but, rather, seemed to 
be a function of the individual’s ability to 
predict, per se. In the nature of a trend, it ap- 
peared that various professional groups were 


peers 


predicting 


less able to predict the area of adjustment 
most closely related to their own area of spe- 


cialization than were their staff colleagues 


Lasky, Hover, Smith, Bos 


tian, Dufiendack, Nord 
Predictions based on single monthly ratings 
did not reach significance. Fourteen of 16 bi- 
serial correlation coefficients based on predis 
», or on combined (three to six monthly 
group ratings combined into one distribution) 
s were significant at 


Charge 
beyond the 


, 1958 
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CUES INFLUENCING JUDGMENT OF PERSONALITY 
CHARACTERISTICS ° 


ERNST G 


l'niver 


In judging another’s personality character- 
istics one uses various cues, generally without 
ever recognizing the cues themselves. Differ- 

racteristics are likely to be judged 

t cues, and some cues may af- 

ford more information than others. Here, ac- 
cumulative information conveyed by succes- 
sentation of four cues (voice, gestures 
interaction ) 
igs on the following characteristics: 


Sive pre 


face, and social was evaluated 
with ratir 
intelligence, affective tone, sociability, produc- 
to 


influence of 


with regard 
the 


additional cues on ratings, the significance of 


Questions were asked 


tivity. 


relationship among ratings, 


the introduction of previous ratings, and the 
comparison of “first impression” with “long 
ratings. Asch (1946) 
he first judgment and its 
ucceeding judgments. Newcomb 
ibed the factors which enhanced 


icquaintance stressed 


he 


mportance oti t 


fluence on 


> aescti 
interpersonal attraction as frequency of inter 
ictions, perception of reciprocated attraction, 
certain combinations of personality charac- 
agreement. Allport 
studied perception of 


ind attitudinal 
Ve rnon 


lily expression and facial expression, 


(1933) 
giv- 
emotional impact and 

y of agreements in judgments. Wolff 
3) was concerned with agreement reached 
and behaviors of a 
together. Again, the 
each judgment were not of major 
Dukes (1954), 
and Newcomb (1956), in stud- 


ttention to the 


; y 
L101) 


as to which expressions 


given individual belong 
cues io! 
concern. Secord and Bevan 


Asch (1946) 


on 


perception 
cues comprising 
lation of judgment but investigated 
within one event, for example, 
facial expression. Gage (1952) studied judg- 


ies personal were more 


with the specific 


COncE nec 

the 

those cues 
was supported in part by a U.S 

nt No. M 19 

> inde lt 


bted to 
the 


Lyle I 


analysis of the 


Bourne for 


data 


BEIER ant 


JOHN STUMP! 
t Utah 

ments of interests from expressive behavior 
through Kuder ratings given to the “judges 
and and that the 
judges were fairly consistent in their ratings 
While Gage’s study 
appeared to be similar to the present study 


strangers’ discovered 


of five expressive tasks 


it appeared that no study has used accumu 
lative cues and the question of this consist 
ency as a basis of research. In two investiga 
tions on the “Response to the human face a 
a standard stimulus” (Beier, Izard, Smock, & 
1953; 1957) “liking l 

to 
judgments were formed in reaction to the hu 


Tougas and 


ing’ ratings were used investigate how 


exp 
(pal 


only 


man face. The present study was an 


sion in two ways: instead of the face 


iccumulative cues were introduced, and in 


stead of a liking—disliking rating, a four-area 
rating was introduced 

Specifically, the present study investigated 
the following questions 


., = 
(intelligence 


1our 


areas of personality characte 


istics affective tone, sociability 
ind productivity) were judged, would judg 
ments remain constant as the judges (J) re 
ceived cues cumulatively from observing the 


(dad) voi e. { h) 


participant’s (O) gestures, (¢ 
facial expression, and (d@) interaction with the 
idges? 

2. Would those judgments which did not 
remain stable become stable with some par 
ticular accumulation of cues, i.e., what 
the minimum information the J needed in or 


der to reach a stable decision? 


was 


3. Would the staggered introduction of rat- 
ings of the characteristics have any influence 
on the trend in which the characteristics were 
rated? 

4. How did ratings of personality charac- 
teristics derived from first impressions differ 
from ratings made by individuals who knew 
Os for a long period of time? 
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Procedure 


The task was (a) to develop an instrument 


to obtain ratings of the four personality chai 
acteristics, (4) to select Os as the subjects t 
be judged, (c) to devise a proper method o 
cue presentation, (d) to administer the i 

strument and cue presentation to the Js 

(e) to obtain ratings from a long acquair 
ance group. 

1. Judgments were rated with words 
noting four characteristics of personality 
telligence, affective tone, sociability, and | 
ductivity. The four characteristics themselve 
represented an arbitrary choice from amon 
a large number of possible personality chara 
teristics. The words had been gathered in th 
following manner: undergraduate 
students were given the task of writing dow: 
is many words as they could think of under 
each of the four characteristics. Each of the 
words was counted for the number of times 
occurred under one heading. If it occurred at 
least 30 times (e.g., if at 
wrote “bright” under “intelligence”’) 
used in a second alphabetical list of word 
This list was presented to 43 undergraduate 
students who were given the task of assign- 
ing each of these words to one of the fou 
characteristics. From the number of students 
who placed a given word into the selected 


some 60 


least 3( 


torial help active at the University, 


racteristic, percentages of agreement wer 


ilated for each word 
For the 


words were selected for ezch of 


rating scales ir tue present study 
the four 
positive 


iracteristics three 


words for each charac 


There were 
tnree 


nt scale 


‘negative” 
ach word was placed on a seven 
, the endpoints of which were called 
The 
x words of one characteristic accordingly 

42. The 
of the 


ich 


t” and ‘most.’ range of for 


scores 
group of words representing 
ordered 
four different booklets 
idministration were constructed. The 


four characteristics were 
manner that 


first 


age would contain only one group of words, 
the third 


hree groups, and the fourth page four groups 


1e second page two groups page 


ich of four booklets contained a differ- 
sequence of characteristics as can be seen 
Table 2 


It was necessary to construct these different 


the 


ooklets to test whether the occurrence of a 
revious rating would influence the value of 


llowing ratings. Additionally, each of the 


ir pages of all booklets contained a like 


lislike scale, and space was left for com- 


ents and suggestions 
It was decided to use the junior jani- 


some of 


vhom planned to go to college and some did 
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not. Six junior janitors from the University 
of Utah were given the MMPI test. Three 
clinical psychologists using the method of 
paired comparison selected the four subjects 
most diverse in the characteristics to be rated. 
The Os who appeared most different from 
each other were selected for the study. They 
were male, between the ages of 16 to 19. 

3. Each O was presented to a class of stu- 
dents. The various cues were introduced suc- 
cessively. For this purpose a stage was built 
with an attached curtain which could be low- 
ered and raised. A screen shielded the O upon 
his entry from the view of the class. After the 
presentation of each cue Js rated O on the 
appropriate page of the booklet. The follow- 
ing cues were introduced: (a) Voice. Hidden 
by the curtain, O talked to the class for one 
minute. The talk was spontaneous since in 
the absence of reliable knowledge it was rea- 
soned that a memorized talk would be 
removed 


too far 
situation. The O was 
given the topic of marriage to discuss. Thus, 
this was not only 


from a life 


a voice presentation but 
transmitted attitudes and opinions of the par- 
ticipant. (b) Gestures. The second cue intro- 
duced voice presentation with gestures. The 
curtain was raised so that arms, hands, and 
the upper torso between neck and belt was 
visible. Another topic, 


“father does not want 
car to son” was presented to the O 
with the that he use gestures 
freely in this demonstration. Again the infor- 
mation contained than could be 
obtained from gestures alone, and so the cue 


to give 
instruction 
more cues 
is somewhat misnamed. Perhaps some Os used 
this cue less 
ing that they 
their hands. This cue 


spontaneously than others feel 
had to “overact” to speak with 
, on the surface, did not 
appear to have been a fortunate choice. (« 

Face. Immediately 


following the ratings of 


Booklet 


gestures the curtain went up and O’s torso 
from the waist to the face was exposed to the 
Js. The O was told to look straight ahead and 
to refrain from any facial expression. After 
one minute exposure, the curtain was drawn 
and J make their third 
page ratings. (d) Interaction. The O was in 


structed to involve the class in a three-minute 


were instructed te 


“cheating.”” The class was en- 
couraged to respond. Most Os addressed the 
class for a minute and then asked questions 
With this cue it is likely that attitudes and 
opinions 


discussion of 


addition to 
tion. Generalization from this study 


were communicated in 
the interac 
will have to take this into consideration 

4. The 24 
dents from the University 


female stu 
College 
School of Education of the 
Utah. The Js were given some over-all infor- 
mation on the project and 
after the 
same 


Js were male and 
and the 
University of 


isked to rate O 
introduction of each cue. At the 
time ratings on a like—dislike scale, and 
comments were requested 

5. The rating scale containing all the word 
was sent to four people whose names had been 
supplied by each O. It should be noted that 
this obviously would not represent a random 
group of long acquaintances but rather a 
highly selected group of people who would 
predictably 1 
The E 
their ratings would be 
would not University’s attitude 
toward O. All but one of 


re spt nded 


act more positively toward O 
told the that 


rictly confidential an 


long acquaintance Js 
influence the 
the long acquaint 
T hese 


inces ratings were not 
The 


who knew another person longer was not as 


thought of as accuracy ratings person 
more accurate in his observations 
} on on a larger 

lata was col 

1 the plan had beer 

to develop eventually a design which would 
test accuracy data. Here one 


would lear 


ut differences in ratings based on first im 
which could be ey 
attitudes 


entific 


pression made in a setting 


nected to ponsor fairly obpvective 


students parti ipating na 


ind 


study 


ratings based on at least one year of at 


quaintance in a setting which would probabh 


nonsor tavorahie 


attitude 


limitation ! 


With the knowl 
mind, the 


differer 


edge of these investi 


gators examined the umong the 
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Table 3 


Means of the First Four ( 
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Discussion of Resuiis 


Each of the four Os was judged by a group 
of 60 Js. Each of these groups was subdivided 
into four sections of 15. Each section was sup 
plied with a different booklet (see Table 2) 
In this manner a total of 240 x 60 = 14,40 
scores were obtained. This number was re 
duced to 2,400 by obtaining a sum of scores 
for each of the six words comprising a group 
Three booklets had not been completed, and 
the scores for these booklets were averaged as 
all booklets were needed for the analysis of 
variance. Another deficiency in scale construc 
tion was discovered in that in 15 booklets one 
word was left out in one of the pages and, ac 
cordingly, only five words for the character 
istic were averaged. A third error was it 
troduced by the arrangement of the scoring 
sheet: a few semiattentive judges failed to 
maintain constancy and apparently exchanged 
the meaning of “most” and “least” 
ally.‘ 

It should be remembered that the scores for 
each characteristic for each pamphlet were or 
dered in such a way that a group of Js rated 
this characteristic four times successively; a: 
other, three times successively: a third 
two times successively; and a fourth 
only once. 

There was an 
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[Three separate analyses of variance were 
performed on this data. The first is an analy- 
sis of the differences among four successive 
ratings on all characteristics for Os. The sec 
md is an analysis of the effects of previously 
ivailable but unrated cues on Js first rating 
of O. The third measures the differences in 


final ratings after a varying number of previ 
us ratings had been made.‘ In the following 
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positive information, or, otherwise the fact 
that the Js have more cues available—per- 
mitted the Js to express more favorable rat- 
ings on all characteristics. The T X O inter- 
action (F: 13.35, p > .01) indicated that all 
ratings combined change for each O over the 
four trials. The .01 level of confidence was 
accepted for this study, so T X Ch (F: 2.05, 

> .05) cannot be called significant. This 
would have to be interpreted that, while the 
ratings differ, the characteristics seem to have 
the same stimulus value on succeeding trials. 
By and large, there is little residual variance, 
indicating fairly high consistency among the 
ratings of Js. 

In these means (Table 4) it should be 
noted that the J has seen the previous cues in 
the sequence but had not had the opportunity 
to rate the same cue on the given character- 
istic, as ratings were introduced later on. The 
analysis deals principally with the hypothesis 
that previous available cues will have an ef- 
fect on the J’s first rating of the O. 

The O (F: 22.73, p > .01) and character- 
istic (F: 11.35, p > .01) sources of variance 
again indicate that Os differed significantly 
among themselves, supporting the selection 
process and that the characteristics differed 
from one another. The significant finding on 
cues (F: 11.40, p > .01) was interpreted to 
mean that the more cues the J has available 
to him before he attempts to rate, the higher 
will be the rating, a finding which is easily 
supported by an inspection of the means. 

It becomes evident that the ratings did not 
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become more favorable because of previous 
ratings, but primarily because of previous 
cues. The finding suggests that Js formed 
judgments of other people regardless of 
whether or not they were specifically asked 
to do so. 

The significant O xX CA interaction (F: 
3.61, p> .01) was interpreted as follows 
while the Os have the same general profile on 
the consecutive ratings of each characteristic, 
the profiles differ when based on the staggered 
“first ratings” only. In other words, there is 
greater heterogeneity in the profiles of the 
Os based on data of first ratings from Js who 
had 0-3 previously unrated cues, and greater 
homogeneity when the cue was rated each 
time it was presented. Apparently, here, the 
very fact of rating had a constricting effect 

The O X Cu (F: 1.63, not significant) and 
Ch X Cu (F: 1.51, not significant) interac- 
tions support the finding of consistency of 
ratings. 

The main question to be answered by the 
analysis of these means deals with the differ- 
ences in final rating after various number of 
previous ratings have been made. 

Support was found for-the previous finding 
that Os were signi: cantly different from each 
other (F: 34.02, p O01) and that the char- 
acteristics differ (F: 10.42, p> .01). The 
finding of lack of significance between the 
means of previous judgments support the 
previously reported interpretation that the 
fact that a person rated a characteristic previ 
ously does not contribute to the differences 
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Table 


Means of Ratings of All Characteristics on 


Affective Tone 


Sociability 


Ratings 
With 2 Previous 
Without’ Previous 


Ratings 
Rating 
Rating 
Ratings 
Ratings 
With 1 Previous 


With 3 Previous 
With 1 Previous 
Without Previous 
With 3 Previous 
With 2 Previous 


32.7 
33.7 
30.4 


35.7 


wa 
~1 & 
w 
+ 
wn 
w 
wn 
. Ww 
— Ww 
_ 


31.5 
29.1 
30.4 


ww 
> Se 
nun & ¢ 
2s 

~~ t 

0 t 


ios) 
o 
st 


among ratings. Instead, it supports the view 
that the number of cues is the main con- 
tributing factor. The significant O x CA in- 
teraction (F: 3.89, p > .01) indicated that 
the profiles of the four Os differ significantly 
in the final rating due to the varying number 
of previous ratings. In other words, while the 
Os have the same profiles on the consecutive 
ratings of each characteristic, the end result, 
i.e., the ratings on this last cue alone, do show 
difference as previously the staggered “first 
ratings” alone have shown differences. The 
Os appear similar in their general profile 
trend, but dissimilar in the values which make 
up their profiles, somewhat analogous to a 
paradigm of parallel wavy lines. 

The lack of significance in O X R and Ch 
x R to all interactions with ratings gave sup- 
port to the argument that previous cues, but 
not ratings, were the important determinator 
of the value of these ratings. 

In Table 6 the trend generally indicated an 
increase in liking as more cues were presented 
perhaps supporting the finding of increased 
favorable ratings. In two subjects (1 and 4) 
the means presented a clearly descending line, 
while in Subjects 1 and 3, only the final cue 
introduction shows an increase in “liking.” 
The “gesture” cue seemed to contradict the 
trend most markedly, possibly because of its 
forced content, O was instructed to give em- 
phasis to their talk by gestures. It might be 
desirable to select a more harmonious cut in 
the future as the forced behavior might bring 
intervening variables into the ratings. The 
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comments made by the rating Js stimulated 
the investigators to think along the lines of a 
more “personalized” rating system in which 
the Js themselves would contribute their char- 
acteristics to be rated 

Finally, in a comparison of the ratings of 
the four Js of “long acquaintance” with tle 
“first impression” Js, it appeared that three 
out of four subjects were underrated on all 
characteristics by the “first impression” Js. 
Only one subject was overrated by these Js, 
as compared to the “long acquaintance” Js. 
While the number of “long acquaintance’ 
Js is too low to warrant an analysis of the 
data, it might be speculated that higher rat- 
ings of the “long acquaintance” Js may be at 
least partially due to the setting, where the 
60 “first impression” Js had no stake in their 
judgment, while the “long acquaintance” Js 
were selected by the Os as people friendly to 
themselves and perhaps wanted to give as fa- 


Table 6 


Means of Ratings on Like-Dislike Scal 
by All Js on Four Os 
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vorable ratings as possible. It would be in- 
teresting to discover to what extent the length 
of time of acquaintance really influenced the 
ratings and if the suggested tentative hypothe- 
sis, “Does familiarity breed appreciation?” 
has an empirical basis. Social class may very 
well be a factor in influencing judgments. 
Differences in social class between J and O 
may be a significant variable to be studied. 
The judges used here were above average in- 
telligence. The intelligence of the Js as re- 
lated to the intelligence of the Os should be 
another factor reflected in the ratings. Age is 
yet another factor in the present study; all 
Js were considerably older than the Os. These 
are questions which should be considered in 
future research. 


Summary 


In this study each of four Os were shown 
to groups of 60 Js for ratings of personality 
characteristics. The Os were presented under 
different cues. First the Js heard only O’s 
voice; second, Js also saw O’s gestures; third, 
Js saw O’s faces; and fourth, Js participated 
with O in a discussion. After each of the cue 
presentations, the J had to rate the O on one 
or more characteristics. The rating scales were 


composed of words connoting intelligence, af- 
fective tone, sociability, and productivity. 
lhey were devised in such a manner that 


each characteristic would occur once first, 
once second, once third, and once on the last 
cue only. In addition, ratings from four “long 
acquaintances” were obtained for each of the 
participants. 

To the first question, which judgments re- 
main constant under accumulation cue pres- 
entation, it was found that ratings for all cues 
and all participants generally showed an in- 
crease toward more favorable ratings. 

The second question, whether or not the 
ratings level off with particular cut and par- 
ticular characteristics had to be answered in 
the negative. 

A third question, whether the staggered in- 
troduction of ratings on characteristics would 
influence the consequent ratings was answered 
in the negative. No significant influence was 
discovered. 

The fourth question, concerned with differ- 
ence between first impression ratings and long 
acquaintance ratings was answered by inspec- 


tion only. lt appeared that by and large the 
long acquaintance ratings were more favor 
able than first acquaintance ratings. 

A few critical comments with regard to the 
study should be considered. One was the set- 
ting—the J worked in a group setting which 
may have minimized cue information gained 
on first impression. They also worked in a 
reasonably objective setting where they did 
not have to commit themselves, which is dif- 
ferent from the “long acquaintance” who were 
likely favorably inclined toward the Os. The 
very conformity of the increase in favorability 
of the ratings for all cues and all Os was in- 
terpreted to mean that Js may have a com 
mon pattern to meet the stranger: ‘caution’ 
and then “greater acceptance.” It was thought 
likely that the group setting, the lack of in- 
volvement in the ratings, and the above av- 
erage intelligence of the Js and the approxi- 
mate homogeneity of their social class were 
more important determinants of the value of 
the ratings than individual difference of the 
O. Future research on these “setting cues’’ is 
recommended.°® 
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The complex domain of personality has 
been subjected to numerous attempts at sim- 
plification through factor analytic techniques, 
but the results of these efforts have been 
somewhat disappointing to those who had 
hoped in this way to achieve major concep- 
tual advances. Comparison of a sample of 
such studies often leaves the reader somewhat 
disheartened at the lack of continuity that he 
finds. 

Careful reviews, such as that of Eysenck 
(1953), suggest, however, that the picture 
may be less black than it seems. Eysenck 
stresses the frequency with which the same 
two major personality factors have been iso- 
lated by investigators working with very dif- 
ferent kinds of instruments and variables. He 
points out that similarities in results are often 
masked by variations in rotation positions, or 
by failure to carry out second-order analyses 
of oblique solutions. Even when solutions are 
similar, differences in the conceptualization of 
the factors imply a greater disparity between 
experiments than actually exists. 

The first of the two recurrent factors ob 
served by Eysenck suggests a dimension of 
ego-weakness vs. ego-strength, or, in Eysenck’s 
terms, “general neuroticism” vs. “will.” The 
second factor seems best defined by Jung’s 
bipolar conception of introversion-extraversion 
(Jung, 1924; Eysenck, 1953, p. 318). 

Factorial studies of the Minnesota Multi- 
phasic Personality Inventory have until re- 
cently failed to approximate this general 
trend. A recent volume by Welsh and Dahl- 
strom (1956, p. 264) lists eight factorial stud- 
ies of the MMPI, and Welsh comments: 

1 This research was carried out under the direction 
of Robert F. Bales. The larger project of which the 
study is a part was facilitated by the Laboratory of 
Social Relations, Harvard. Funds were supplied by 
the Rockefeller Foundation 

2 Now at Cornell University Medical College 


In almost all the studies there is essential agree 
ment as to the loadings of two factors although the 
interpretations and the name assigned to these fac- 
tors vary. One factor (usually the first) shows very 
high loadings on .. . (Pt) and .. . (Sc) with nega 
tive loading on scale K whenever it is used. A second 
factor shows fairly high loadings on the neurotic 
triad, especially . (Hy) and .. . (D), with nega- 
tive loading frequently appearing on . (Ma) 

Unpublished studies have been carried out (by 
Welsh) on three different populations . all three 
studies confirm very clearly the factor loading pat 
terns outlined above 

For the most part these studies were re- 
stricted in scope to the original clinical scales, 
and it was difficult with so few scales to de- 
fine the factors clearly. More recent studies 
have profited from the development over the 
past decade of a large number of nonclinical 
scales. These provide wider coverage of the 
domain of personality than does the original 
battery, which was concerned primarily with 
the diagnosis of pathological phenomena. We 
will discuss these studies after first presenting 
our own research. 


Procedure 


This research grew out of a long-term labo- 
ratory study concerned with the prediction of 
interpersonal behavior in small groups. A pre- 
liminary goal of this research was to achieve 
a clarification of the dimensions of the MMPI 
in more general terms than the clinical em- 
phasis of the test has heretofore allowed. For 
this purpose we included 19 nonclinical scales 
in our analysis in addition to the original 13 
clinical and validity scales. The selection of 
these scales was based upon our interest in 
predicting certain aspects of interpersonal be- 
havior, and this concern determined the do- 
main of scales to be analyzed. Some scales 
have not been as fully validated as might be 
desired, while others, such as Gough’s CPI 
scales (1957) are not fully represented in the 
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MMPI. Many of the scales have a number of items, however, almost obliterates some scales 
items in common, and the intercorrelations (Welsh et al., pp. 264-281), and the validity 
among these scales are undoubtedly exag- of these truncated scales is problematical. The 
gerated thereby. Removing all overlapping authors felt that retention of overlapping 


Table 1 


Intercorrelations of 32 MMPI Scale 
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items was the lesser of two evils, but in any 
case the close correspondence noted below be- 
tween this study and a study using truncated 
or “prime” scales suggests that the practical 
significance of the problem posed by item 
overlap may have been exaggerated. 

The 32 scales used are as follows: 


L—Lie; F—Validity; K—Ego functioning; H 
Hypochondriasis; D—Depression; Hy—Hysteria; Pd 
—Psychopathic Deviate; Mf—Masculine-feminine in- 
terest ; Pa—Paranoia; Pt—Psychasthenia ; Sc—Schizo 
phrenia; Ma—Hypomania; Si—Social Introversion; 
Es—Barron’s ego strength scale (1953)—predicts re 
sponses to psychotherapy; Je—Gough’s intellectual 
efficiency scale (1957)—a “nonintellectual intelligence 
test”; Lp—Oettel’s leadership scale (1952); Ai 
Gough’s “achievement via independence” (1957) 
predicts academic achievement in introductory psy- 
chology courses ; Sy—Gough’s sociability scale (1957) ; 
Ac—Gough’s “achievement via conformance” (1957) 
—predicts academic achievement in high school; Re 
—Social responsibility scale (Gough, 1957); Do 
Dominance scale (Gough, 1957) ; Pr—Gough’s preju 
dice scale (1951); St—Gough’s status scale (1948) ; 
Im—Impulsivity (Gough, 1957) ; Sp—Social presence 
(Gough, 1957); Fm—Hecht’s feminine masochism 
scale (1950); Rp—McClelland’s role-playing ability 
scale (1951) ; R—Welsh’s factorial scale of “repres 
sion, denial” (Welsh & Dahlstrom, 1956, pp. 264 
281) ; A—Welsh’s factorial scale of “anxiety” (Wels! 
& Dahlstrom, 1956, pp. 264-281) ; Dp—Navran’s de 
pendency scale (1954) ; To—Tolerance scale (Gough 
1952) ; O-I—Originality potential (Gough, 1952) 


The test was administered to 160 Harvard 
College freshman and scores obtained on these 
32 scales. The mean scores for this sample 
approximate college norms for scales where 
such norms are available. 

The 32 scales were intercorrelated and the 
matrix factor analyzed by means of the com- 
plete centroid method of Thurstone (1947) 
After the extraction of the third centroid, two 
criteria indicated the undesirability of further 
factoring: (a) the third factor accounted for 
only 5% of the total variance, and (4) the 
third factor residual matrix did not contain 
significant coefficients beyond the number ex- 
pected by chance. The matrix was then ro 
tated to simple orthogonal structure 


Results and Discussion 


Table 1 shows the intercorrelation matrix, 
and reveals the generally high correlations be 
tween scales which other investigators have 
found 
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Tables 2 and 3 reproduce the centroid and 
rotated loadings, respectively. 

In Table 3 the main elements in the inter- 
pretation of Factor I are readily apparent. 
High saturations may be noted with regard 
to Pt, Sc, and Welsh’s A (Anxiety), thus pro- 
viding a close match with previous studies. 
High negative loadings are contributed by 
Lp (Leadership), To (Tolerance), Es (Ego- 
Strength), and Je (Intellectual Efficiency). 
We have defined this factor as a dimension 
of Ego Weakness vs. Ego Strength. Factor | 
accounts for 39% of the total variance and 
72% of the common factor variance. 

Factor II exhibits high positive loadings on 
Welsh’s R (Repression), Re (Social Responsi- 
bility) and Si (Social Introversion) and nega- 


Table 2 


Centroid Factor Loading 
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Table 3 


Rotated Factor Loadings 
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tive loadings on Ma and Sy (Sociability). 
The nature of this bipolarity suggested an 
interpretation of this factor in terms of Jn- 
troversion—Extraversion. Factor II accounts 
for 10% of the total variance and 19% of the 
common factor variance. 

The most important loading on Factor III 
is Hy, which has low saturations on I and II. 
None of the remaining loadings is of suffi- 
cient size or purity to be of substantial aid in 
the interpretation of the factor. It is worthy 
of note that the factor has loadings on all 
three members of the “neurotic triad,” and is 
thus very similar to the so-called “neurotic 
factor” of some of the early studies. Other 
loadings, however, such as the positive loadings 
on To (Tolerance) and Ai (Achievement via 
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independence) and the negative loading on 
Pr (Prejudice), suggest that the factor may 
be absorbing nonpathological elements from 
the clinical scales—an illustration of the haz- 
ards of factor interpretations based on clini- 
cal scales alone. We do not feel that a clear 
interpretation of this factor is possible at pres- 
ent, but have tentatively called it Tender- 
Minded Sensitivity. Because of its small size 
(it accounts for only 5% of the total variance 
and 9% of the common factor variance) and 
doubtful interpretation, Factor III was not in- 
cluded in the further analyses which are dis- 
cussed below. 


The Identification of Introversion 


The first of these three factors, Ego-Weak- 
ness vs. Ego-Strength, has been isolated with 
such regularity in previous work as to be non- 
problematic. Since Introversion—Extraversion 
has not heretofore been mentioned in con- 
nection with factorial interpretations of the 
MMPI, we shall discuss this identification in 
more detail. 

The negative end of the factor, with high 
loadings on Ma, Sy (Sociability), 7m (Im- 
pulsivity), St (Social Status) and Sp (Social 
Presence) may be readily identified with ex- 
traversion. The positive end, however, seems 
to contain a variety of scales whose common 
element is difficult to perceive. For the clus- 
tering of four of these positive loadings—D, 
Si, Ac (Achievement via conformance), and 
O-I (Originality potential)—we find consid- 
erable support from Eysenck, who quotes 
Guilford as saying: “It would seem that there 
is some basis (i.e., their high intercorrelation) 
for lumping together some characteristics bor 
dering on seclusiveness with some implying a 
thinking person and still others that indicate 
depressed emotional tendencies and calling the 
resultant the introvert” (Eysenck, 1953, p 
104; Guilford & Guilford, 1939, p. 34) 

The tendency of Factor II to split Ego 
Weakness into “behavior disorders’ (mania 
impulsivity) and (de 
pression, feminine masochism) echoes studies 
cited by Eysenck (1953, pp. 60, 89-91, 125) 
as lending support to the psychoanalytic defi 
nition of introversion 
nance over id activities 
id predominance 
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Such a notion would help to explain the posi- 
tive Factor II (Introversion) loading on Re 
(Social Responsibility). 

No interpretation of Factor II will be ac- 
ceptable, however, if it fails to take into ac- 
count Welsh’s R scale, which boasts the high- 
est loading on Factor II and is virtually the 
only variable which is independent of Factor 
I. Inspection of the items in this scale sug- 
gests that Welsh’s tentative label “repression, 
denial” is somewhat misleading, and that the 
terms “inhibition” or “constriction” might be 
more appropriate. The statements which are 
“denied” fall largely into two categories: (a) 
interest statements of a wide variety, such as 
“T like mechanics magazines,” “I like dra- 
matics,” and “I think I would like the work 
of a building contractor’; and (6) expres- 
sions of hostile, gregarious, and excited feel- 
ings, such as, “At times I feel like smashing 
things,” “At times I am full of energy,” “I 
enjoy social gatherings just to be with peo- 
ple,” and “I enjoy the excitement of a crowd’ 
(Welsh & Dahlstrom, 1956, pp. 271-272) 
These statements would seem to appeal di 
rectly to the extravert, who is expressive and 
labile, and cathects new activities easily. The 
more cautious and inhibited introvert, who is 
slow to change, and seeks his satisfactions in 
his own inner life, would tend to reject state- 
ments of this kind (Eysenck, 1953, p. 21) 

There is another characteristic of the R 
scale which is worthy of note, namely, that 
all of the items are counted when marked 
“false.” This is equally true of the Lie scale 
which also has a substantial loading on Fac 
tor II. Furthermore, when we examine the 
Mania and Depression scales (which have so 
often marked the two poles of this factor) we 
find that the Mania scale contains signifi 
cantly more True items than the Depression 
Scale (chi square = 17.64, p < .001). This 
suggests the possibility that what we have 
labelled extraversion is associated with a gen 
eral tendency to agree with any item what 
ever the content, while what we have called 
introversion involves a converse tendency to 
disagree or mark False 

This line of thought was prompted by an 
unpublished analysis by Couch and Keniston 
of a 360-item personality inventory, in which 
they found that the total number of positive 
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(Agree) responses was a manifestation of a 
significant personality syndrome. This “tend- 
ency to agree” correlated positively with items 
that reflected a love of novelty and change, 
high stimulus reactivity, anal expressiveness, 
and a liking for enthusiastic but superficial 
involvement—all extraversive characteristics. 
Most prominent among negative correlates of 
‘tendency to agree” was a scale developed 
by Couch and called “psychological inertia,’ 
which reflects a disposition to control impul- 
siveness (anal retentiveness), a slowness to 
change cathexes and a long secondary process 
in mental functioning—all introversive tend- 
encies.' 

This dimension seems highly related to our 
interpretation of Factor II as Introversion 
Extraversion. A further support of this corre- 
spondence of dimensions is the correlation of 
which Couch found between “tend- 
ency to agree” on the 360-item inventory and 
the tendency to mark True on the MMPI. 
This total true score on the MMPI correlates 
with Welsh’s R scale, a finding 
which lends further credence to our generali- 
zation. 

If this interpretation of Factor II is valid, 


r 65. 


’ 75 


it should be possible to give a new concep- 
tualization to the vectors which lie midway 
between our orthogonal axes of Factors I and 
II. These four vectors should reflect Normal 
Introversion, Normal Extraversion, Disturbed 


It is rather interesting to find a detailed descrip 
tion of this aspect of introversion-extraversion in 
Freud, who, however, reserved the term “introver 

itself to a quite different characteristic which 

was associated with, rather than orthogonal to, neu 
rosis. The Jungian conception of introversion is moré 
approximated by what Freud called “adhe 
siveness of libido” (Freud, 1953, pp. 344-345). He 
fers to patients who “cannot make up their minds 

to detach libidinal cathexes from one object and dis 
place them to another.” He likens the 
ulptor who with these cases works in hard ston 

vhile with their antitheses molds soft clay or even 
udds despairingly, writes on water, due to the 

ase with which new cathexes are abandoned. In the 

adhesive patients he sees an “exhaustion of the ca 
pacity for change and development” and a “psychical 
nertia” quite independent of normal resistance (a 
listinction relevant to our discussion of the repres 
Freud does not attempt to account fo: 
attributes 


closely 


analyst to a 


yn scale) 
types in psychoanalytic 


terms but 


hem to fundamental differences rhvthm 


hical development 
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Table 4 


Theoretical Matrix for Pooling Square Technique 


Variable 


Variable 


Introversion, and Disturbed Extraversion. But 
before examining the factor space in detail, it 
is necessary to discuss briefly the techniques 
we used in generalizing our analysis. 


The Construction of Factorial Tests 


We first wished to obtain reliable measures 
of the MMPI factorial dimensions, using the 
knowledge of the factor space gained from the 
factor analysis. For this purpose the pooling 
square technique (Thompson, 1949) is per- 
haps the simplest and most useful. It allows 
one to determine the hypothetical loadings, 
on each factor, of the sum of any group of 
variables included in the proposed measure. 
If a matrix is constructed as shown in Table 4, 
with A = the theoretical communality of the 
factor in question (1.00), B = the factor load- 
ings of the several variables which are candi- 
dates for inclusion as measures of the factor, 
and C the intercorrelations of these vari- 
ables (obtained from the original correlation 
matrix), then the correlation of this set of 
variables (equivalent to an average of stand- 
ard scores)* with the theoretically defined 
factor (denoted Aj;) is 


B 
VAC 


*When the variable domain involves heterogeneous 
variances, as in the present study, it is necessary to 
convert all component scale scores to standard scores 
prior to computation of the new factor test score 


but in this case A = 1.0, thus 


aj 
Vor; 

In this way it is possible to assess the load- 
ing of the entire scale on each of the dimen- 
sions of the factor matrix. The selection of 
variables to be included in the scale attempts 
to maximize the communality of the new test 
and minimize the saturation on other fac- 
tors by equalizing their positive and negative 
loadings. 


An = 


The Factor Fusion Approach 


We have long been of the opinion that if 
factor analysis is to make significant con- 
tributions to personality theory it is impera- 
tive to attempt to conceptualize the entire 
variable domain. For this reason, it is our 
practice to define and measure those vectors 
lying midway between the primary reference 
axes. In other words, once having established 
the primary reference axes by the usual sim 
ple structure criterion, we rotate the axes 45 
degrees and repeat the procedure of defining 
the factors and constructing factor tests by 
the pooling square technique 

We have adopted the practice of calling 
these new factors “factor fusions,” inasmuch 
as they may be conceived as combinations of 
the primary reference axes. To do so is not 
to overlook the fact that the decision as to 
which factors are to be considered the pri 
mary reference axes is a completely arbitrary 
one. It is our view that ideally nothing other 
than theoretical relevance should fix the pri 
mary axes in any particular position 

Although this approach is something of a 
departure from usual factor analytic pro 
cedure, the view that one should be able to 
measure any vector within the factor space 
was recently stated by Kuder (1954) and re 
flects a viewpoint that is becoming more wide 
spread. The work of Leary (1957) and his 
associates, for example, is based upon a two 
dimensional system of interpersonal behavior 
in which 16 equidistant vectors are measured 
independently. Our practice of defining and 
measuring those vectors lying midway be 
tween the primary axes is a first step in this 
We feel that it has 


direction two advantages 
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not realized in either standard orthogonal or 
oblique solutions. 

The first advantage is conceptual clarity. 
A better understanding of the nature of the 
fixed position factors is produced when they 
are examined in relation to other dimensions 
in the factor space. It is often particularly 
profitable to test the validity of the concep- 
tualization of the original factors by obtain- 
ing predictions (made on the basis of these 
conceptualizations alone) of the nature of the 
factor fusions before the rotation is made. 

The second advantage is the increased prob- 
ability of a continuity of studies. The arbi- 
trary placing of axes according to the simple 
structure criterion maximizes apparent di- 
versity of findings if fusion positions are not 
also interpreted. This diversity is often due 
to such accidents as the selection of variables 
to be included in the analysis. For example, 
if Investigator A includes more tests which 
lie on Axes I and II, while Investigator B in- 
cludes more tests which lie on Axes I’ and II’, 
their simple structure solutions will lie 45° 
from one another. An impression of great dis- 
parity will be created when in reality an al- 
most perfect replication has been achieved. 


Tab 


Estimated Loadings on MMPI Fact 


Factor I Ego-Weakness vs. Ego-Strength 
Psychasthenic, 
and Psychopathic Scales, 


Schizophrenic, Anxiety) 
} 


Leaders 


ance, (—) Ego-Strength, (—) K-Suppress 


Intellectual Efficiency Scales 


Factor II 


Introversion vs. Extraversion 
Repression-Denial, Social Responsibility 


version Scales, (—) Hypomania 


Fusion 
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Social Withdrawal vs. Social Participatior 
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bility Achievement via Conforn 
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The Fusion Factors 


The fusion factor whose positive end lies 
between the positive ends of Factors I and II 
we will call Fusion Factor A. As can be in- 
ferred from Table 3, its highest and purest 
loadings are on Si, D, and Fm (Feminine 
Masochism) on the positive end, and Sp (So- 
cial Presence), Sy (Sociability), and St (So- 
cial Status) on the negative end. We have 
tentatively labelled this factor Social With- 
drawal vs. Social Participation. 

The fusion factor whose positive end lies 
between the positive end of Factor I and the 
negative end of Factor II we will call Fusion 
Factor B. Its highest and purest loadings are 
on Jm (Impulsivity) and Ma on the positive 
end, and Re (Social Responsibility) and Ac 
(Achievement via conformance) on the nega- 
tive. Originality (O-7) and Ai (Achievement 
via independence) also lie along the negative 
end of this axis but have more modest load- 
ings. We have tentatively labelled this fusion 
factor Impulsivity vs. Intellectual Control. 

Table 5 presents the pooling square esti- 
mated loadings of the constructed tests for 
Factors I and II and Fusion Factors A and 
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\ 
\ 
\ 
\ 


‘\ 
Soci INTELLECTUAL 
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CONTROL 





EGO-STRENGTH 
Fig. 1. Factors and factor fusions 
B, along with the scales of which the tests 
are composed. 


Summary of Factor Interpretations 


In order that the factors and factor fusions 
may be visualized in relation to one another, 
a graphical presentation of the four axes is 
shown in Fig. 1, with the labels we have 
chosen. This should help to clarify the sum- 
mary description of the four dimensions which 
follow. 

Factor I: A dimension of ego-weakness vs. 
ego-strength. Maladjustment, “general neu- 
roticism,”’ anxiety, dependency, and a tend- 
ency toward personality and behavior disor- 
ders, as opposed to healthy nonanxious per- 
sonality, absence of disorders, and a tendency 
toward leadership and intellectual ability. 

Factor II: A dimension of introversion vs. 
extraversion. High “psychological inertia” or 
“adhesiveness of libido” as opposed to ease 
and lability of object cathexis. Cautious, con- 
trolled, inhibited, intellectual, skeptical, intra- 
punitive personality vs. adventurous, impul- 
sive, expressive, gregarious, naive, extrapuni- 
tive personality. In psychoanalytic terms this 
dimension expresses the superego-id balance 
within the personality, while Factor I ex- 
presses the strength of the ego. 

Fusion Factor A: A dimension of social 
withdrawal vs. social participation. Shy, se- 
clusive, submissive, guilty, depressed, mas- 
ochistic personality, as opposed to poised, so- 
ciable, dominant, confident, and spontaneous 
personality 
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Fusion Factor B: A dimension of impulsiv- 
ity vs. intellectual control. Impulsive, manic, 
excitable, erratic, uncontrolled, delinquent per- 
sonality as opposed to responsible, controlled, 
intellectual, stable, original, intraceptive, in- 
sightful personality. 

It might be added that in psychoanalytic 
terms, Factor A seems to suggest the ego 
overwhelmed by a harsh superego (Depres- 
sion), while Fusion Factor B suggests the 
ego overwhelmed by impulses from the id 
(Mania). Note, too, that Social Withdrawal 
and Intellectual Control, the two vectors ad- 
jacent to Introversion, provide a representa- 
tion of the distinction often drawn between 
“social introversion” and “thinking :introver- 
sion.” 

It should be noted at this point that these 
interpretations of the factors are based on a 
logical-inductive approach, which assumes the 
empirical validity of the MMPI scales. Our 
conceptions of the major dimensions are at 
present theoretical hypotheses, based on the 
inductive implications of the factor pattern 
It would require further research involving 
psychological studies of subjects high, mid- 
dle, and low on the factor scales to give more 
direct empirical support to these conclusions 
Furthermore, the use of these major dimen- 
sional scales of the MMPI in clinical practice 
would add considerably to a clarification of 
the underlying dispositions that 
measured. 


are being 


Comparisons with Other Studies 


As suggested above, the strongest support 
for our factor interpretations comes from 
Eysenck (1953), who found repeatedly in his 
review of factorial studies of personality that 
the bulk of the common factor variance in 
these studies was accounted for by a general 
factor of neuroticism or ego-weakness, and 
a bipolar factor of introversion—extraversion 
That this same structure should also emerge 
from a study of the MMPI is encouraging to 
those hopeful of isolating stable personality 
dimensions of widespread applicability. Stud- 
ies of the Guilford inventory by Lovell (1945) 
and North (1949) seem particularly similar 
to ours. 

We feel, however, that the isolation of ou 
fusion dimensions adds most significantly to 
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the struggle for factorial continuity. Some of 
the studies cited by Eysenck, particularly 
those of Goldman-Eisler (1951; Eysenck, 
1953, pp. 123-126), seem to fit poorly into 
his two-dimensional framework. Although Ey- 
senck sees a resemblance between Goldman’s 
second factor of oral optimism—oral pessimism 
and extraversion-introversion, Goldman’s first 
factor, defined by impulsion vs. deliberation, 
is hardly one of neuroticism or ego-weakness. 
It now becomes clear, however, that Gold- 
man’s factors very closely approximate our 
fusion factors, while her 45° vectors, though 
quite poorly defined, seem to approach our 
Factors I and II. Impulsion vs. deliberation 
corresponds to our Jmopulsivity vs. Intellec- 
tual Control, while oral pessimism (endo- 
cathexis, aloofness) vs. oral optimism (exo 
cathexis, nurturance) corresponds to our 
Social Withdrawal vs. Social Participation. 
Eysenck (1953), for example, defines oral 
optimism as “distinguished by . gener- 
osity, bright and sociable social conduct, ac- 
cessibility to new ideas and ambition accom- 
panied by sanguine expectation,’ and oral 
pessimism in terms of “moods of depression 
and attitudes of withdrawal” (p. 124). 

We should like to suggest the hypothesis 
that an orthogonal solution of a factor analy- 
sis of any personality inventory or battery of 
trait ratings of sufficient size and complexity, 
and drawn from a normal population, will 
produce a structure in which all eight 45 
vectors of the two largest factors will be es 
sentially similar to those we have identified 
We feel that deviations from this structure 
are due only to peculiarities of samples, in- 
sufficiently “covered” domains, and the use 
of oblique solutions. 

This hypothesis derives considerable sup- 
port from an examination of the factorial 
studies of the MMPI. While a full review of 
this literature is not appropriate here, a brief 
survey should serve to illustrate the point that 
the more MMPI scales included in a factorial 
study of that instrument, the more closely the 
results approximate ours. 

All of these studies have found a first fac 
tor similar to ours, but in the early studies, 
in which only the clinical scales were included, 
no factor emerged which could conceivably be 


Gene G. Kassebaum, Arthur S. Couch, and Philip E. Slater 


conceptualized as introversion—extraversion. 
Hints were present only in the form of a 
small factor loaded on Ma, D, or both. The 
studies of Cook and Wherry (1950), and of 
Wheeler, Little, and Lehner (1951) fall into 
this category. 

Tyler’s study (1951), which included Pr, 
Re, Do, St, and Ac in addition to the clinical 
falls into an intermediate category. 
His Factor III (Social Aggression and Fric- 
tion), with positive loadings on Ma, Pd, and 
Pa, and negative loadings on Si and Re, re- 
sembles a mirror image of our Factor II. 

Studies by Welsh and his associates (1956, 
pp. 264-281) also fall into this category. 
After a careful examination of previous fac- 
torial studies, Welsh constructed a number of 
special scales, including a set of revised clini- 
cal scales from which all item overlap had 
been eliminated. In addition, the A scale was 
constructed from items which differentiated 
extreme scorers on a scale of general malad- 
justment (Gm). The R scale was developed 
in a similar manner from a special “prime’ 
(no item overlap) D scale. Welsh then factor 
inalyzed this group of special scales and ex- 
tracted three factors. No rotations were car- 
ried out. The first factor was loaded .99 on 
{ and the second .88 on R. 

Our analysis essentially replicates Welsh’s 
findings. A is loaded .88 on Factor I, while 
R is loaded .69 on Factor II. Both the high 
loadings and the orthogonality of his scales 
ire reflected in our analysis.' 

The analysis which most clearly supports 
our findings is an unpublished study by 
Jerome Fisher (1957).® Fisher’s variables in- 
clude 23 MMPI scales and four additional 
measures. Of the five factors extracted, the 
econd and fourth are heavily influenced by 
the non-MMPI variables. The first 
reflect the familiar dimension of 


scales, 


tactor 


seems to 


It might also be noted that if Welsh’s second and 

rd factors are rotated, his third factor also bears 

1 remarkable resemblance to ours. The few differ- 

s existing between these two analyses are un- 

loubtedly due in large part to his use of “prime” 
scales 

We are grateful to Jerome Fisher for the oppor- 

to inspect his analysis in a dittoed progress 

ort entitled, “An empirical study of the relation 

vsical disease to body-object cathexis.” 
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general ego-weakness. The third factor is the 
most interesting from our viewpoint, with 
high positive loadings on Ma, and high nega- 
tive loadings on R, Si, and D. Other variables 
which helped to define our Factor II, such as 
Re, Sy, Sp, and Im, were not included in his 
analysis, but the correspondence is nonethe- 
less striking. 

That previous invesiigators have never con- 
ceptualized MMPI factors in terms of intro- 
version—extraversion seems to be due in large 
part to their heavy dependence upon the 
original 13 scales. Another important con- 
sideration, however, is the fact that MMPI 
researchers have had little in con- 
unsaturated with Factor I, 
due presumably to the strong pathological 
emphasis of the instrument. Many research- 
ers, moreover, have concentrated on the se- 
clusive more than the intellectual and reflec- 
tive aspects of introversion, and least of all 
on the central tendency of this complex trait. 

It should be noted that none of the theories 
regarding typical pathological expressions of 


success 


structing scales 


introversion and extraversion are borne out in 
this analysis. We do not find Factor II sepa- 
rating the cycloid from the schizoid, nor the 
hysteric from the psychasthenic. If we com- 
bine Ma and D by the pooling square method 
we find all four relevant measures (Ma + D, 
Sc, Pt, Hy) cluster obstinately around the zero 
point of this dimension. In the absence, how- 
ever, of either theoretical agreement or ex- 
perimental confirmation in the past regarding 
these relationships (Eysenck, 1953, p. 160), 
we feel justified in leaving the question open 
for the moment. 


Summary 


A factor analysis of 32 from the 
MMPI produced three factors, the first two 
of which were called Ego-Weakness vs. Ego- 
Strength, and 


scales 


Introversion—Extraversion, re- 
spectively. In discussing conceptualization of 
the second factor it was suggested that the 
trait extraversion may be expressed in part 
by a general tendency to agree with all items 
regardless of content. 

We have argued strongly that continuity in 
factor analytic research is completely depend- 
ent upon interpretation and measurement of 
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the entire factor space, and a simple pro- 
cedure for achieving this goal was outlined 
and applied to this study. A method of con- 
structing reliable and factorially “pure” fac 
tor tests was also described. 

A brief review of other factorial studies of 
personality revealed greater continuity than 
is usually apparent when interpretation of 
vectors other than the primary reference axes 
is neglected, and adherence to an arbitrary 
simple structure criterion is maintained. It 
was hypothesized that the two-dimensional 
structure which emerged in our analysis will 
be found in any large-scale factorial study of 
the personality domain, provided the study is 
of sufficient scope and the entire factor space 
interpreted. 
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THE PROBLEM OF INTERMINABILITY IN OUTPATIENT 
PSYCHOTHERAPY 


DONALD R. STIEPER anp DANIEL N. WIENER 


Veterans Administration Mental Hygienic Clinic, 


Termination has rarely been studied as a 
dynamically important and necessary event in 
psychotherapy or counseling. The vagueness 
with which most texts on psychotherapeutic 
techniques deal with it attests to the unstable 
nature of the conceptualization behind acts of 
therapeutic termination. The problem seems 
to center around appropriate criteria for ter- 
minating clients. 

The literature on the subject of termina- 
tion splits itself into three major classes: the 
first tends to deal in generalities with the 
necessary conditions for successful termina- 
tion. For example: Weigert (1952) states 
that “the resolution of the countertransfer- 


ence is presented as a means of determining 
the approaching termination of psychoanaly- 


sis. ’ Masserman (1955) concludes that 
“the completion of psychotherapy . is in- 
dicated not by what the patient says but by 
(a) how he feels, (6) how well he functions, 
and (c) what his prospects for continued im- 
provement without further therapy are rea- 
sonably judged to be.” 

A second group of papers on termination 
deals largely with empirical data on the rela- 
tionships between length of treatment and 
improvement. Notable among these are the 
studies reported by Rogers and Dymond 
(1954) in which Seeman (Chap. VII) re- 
ports that “there is a trend in favor of higher 
success ratings for longer cases” (at least 
twenty interviews). The major criterion for 
termination in the counseling program at that 
time was the client’s decision to drop out of 
therapy. Myers and Auld (1955) corroborate 
this finding, reporting that there is a greater 
frequency of success ratings by therapists for 
patients in treatment for “twenty interviews 
or more than among short-term pa- 
tients. As in many studies of this type, the 
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category “twenty or more” leaves the upper 
limit much more poorly defined than the 
lower one. 

A third group of studies attempts descrip- 
tively to relate other variables to length of 
time in therapy. Middle-class patients tend to 
stay in therapy significantly longer than the 
lower-class patients (Imber, Nash, & Stone, 
1955; Winder & Hersko, 1955). Therapists 
tend to keep patients in treatment longer when 
they initially perceive them to be healthier 
(Conrad, 1954). Inexperienced therapists tend 
to have greater difficulties terminating pa- 
tients than experienced therapists (Auld & 
Myers, 1954; Myers & Auld, 1955; Myers & 
Schaffer, 1954; Schaffer & Myers, 1954). 

In several studies (Kotkov & Meadow, 1953; 
Rogers, Knauss, & Hammond, 1951; Schaffer 
et al., 1954), duration of therapy is consid- 
ered the criterion for success, on the assump- 
tion that successful therapy requires long pe- 
riods of intensive work. Again, the upper 
limits of this relationship remain unconsid- 
ered, so that the patient in interminable treat 
ment is left in limbo. 

The most notable early attempt to deal 
with termination in a systematic, definitive 
fashion was made by Otto Rank (1929), who 
postulated the entire therapeutic process to 
be a “preparation for separation,” a synthetic 
re-enactment of the original experience of 
birth trauma, or physical separation from the 
mother. Characteristically, the point of ter- 
mination was set early in treatment, and the 
patient gradually worked toward the experi- 
ence of successful termination. 

Freud (1953) himself experimented with 
this approach in the attempt to guard against 
what he described as “interminable analyses.” 
He concluded that “the measure is effective, 
provided that one hits the right time at which 
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to employ it.”’ He added, however, that “ 
while the force of the threat will have the ef- 
fect of bringing part of the material to light, 
another part will be held back and become 
buried, as it were, and will be lost to our 
therapeutic efforts.” 

The language of therapy today has pro- 
vided a convenient rationale for seemingly 
interminable therapy cases. The term “main- 
tenance therapy” implies that, for selected 
patients, the ability to function without the 
continued support of their therapists is con- 
stricted. This concept stems, in part, from 
Federn (1953) and other “ego-psychologists” 
who hypothesized that in seriously ill (schizo- 
phrenic) patients, there exists a genetically 
weak ego with highly vulnerable ego-bounda- 
ries, who cannot function without the aid of 
another supportive ego—such as that of rela- 
tive, therapist, or nurse. 

The questions remain: Is indefinitely pro- 
tracted (interminable) therapy the treatment 
of choice in any cases? Is it purposive, effi- 
cient, therapeutic? Or is it the result of poorly 
conceived therapeutic goals based, in part, on 
unsubstantiated theory? 

This paper presents the results of a small 
investigation into the circumstances surround- 
ing protracted (and seemingly interminable) 
psychotherapy with four groups of patients 
in one outpatient setting. 


Procedure and Results 


This study was designed to assess the re- 
sults of brief, and prolonged, periods of psy- 
chotherapy in an outpatient setting. The total 
sample consisted of 66 patients, subdivided 
into the following four groups: 


Group A: 15 white, male veterans currently being 
seen monthly by practitioners outside the Veterans 
Administration on fee basis. Mean length of time in 
therapy is 7.9 years, ranging from 3 years 6 months 
to 10 years. 

Group B: 18 white, male veterans currently being 
seen by therapists on the staff of the VA Mental 
Hygiene Clinic. They also are being seen on an av 
erage of once monthly. Mean length of time in ther- 
apy is 5.3 years, ranging from 2 years 8 months, to 
7 years, 11 months. 

Group C: 15 white, male veterans currently being 
seen by therapists on the staff of the VA Mental 
Hygiene Clinic. They are being seen on the average 
of once every 10 days, with a mean duration of 14 
months 


Group D: 18 white, male veterans who have had 
therapy terminated, for various reasons, in the Men- 
tal Hygiene Clinic. They were seen on the average of 
once every ten days. Mean duration was 7.1 months 


For the purpose of this study, the first two 
groups have been labeled “long-term” pa- 
tients, while the last two groups have been 
called “short-term.” Latent in Group C are 
patients who may be later redefined as “long- 
term.” The first three groups are still in treat- 
ment and were tested, for the purpose of this 
study, while in therapy. The last group has 
terminated treatment. 

For Groups A, B, and C, psychological test- 
ing was obtained while they were in treat- 
ment. The test battery consisted of a brief 
intelligence scale (Shipley-Hartford), the 
Minnesota Multiphasic Personality Inventory 
with Subtle-Obvious keys (Wiener, 1948), 
and Navran’s Dependency Scale (1954), all 
scored, in addition to the traditional four va- 
lidity scales and nine clinical scales with Si 
(Social introversion). 

For Groups B and C, these data were also 
available prior to the time the veterans en- 
tered treatment. For Group D, the data were 

vailable only prior to therapy 

Table 1 represents the comparison of the 
groups on age, intelligence, education, and 
gross diagnostic category. Groups C and D 
ire significantly younger than Groups A and 
B. However, there are no significant differ- 
ences among the groups on education or in- 
telligence, nor do they appear to be signifi- 
cantly different diagnostically. 

On the MMPI, there were no significant 
differences between Groups A and B (long- 
term fee basis and clinic veterans) while in 
therapy, despite the fact that the former 
group had been in treatment a significantly 
longer period of time. The only scale which 
reflected a difference of statistical significance 
was Si (T: 2.08, p < .05), on which the fee- 
basis group (Group A) was the higher. If one 
does not attribute this significance to sam- 
pling error, the interpretation would be that 
the fee-basis group is more socially withdrawn 
than the group being treated in the clinic. In 
all other respects, Groups A and B are similar 
and may be thought of as constituting a 
single group of “interminable” patients. 

In comparing Group B’s pretherapy testing 
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lable 1 


Background of Patients Studied 


Gross Diagnoses 


Education 
Years 


Intellig.* 
Age (Raw Score) 


Pers 


Neuroses Disorder 


Psy« hoses 
Group A 
Group B 
Group ( 
Group D 


40.40 
44.89 


34.87 


55.07 
53.17 
53.60 
51.18 


11.47 12 
10.94 14 
12.13 13 
11.11 15 


31.56 


with testing after 5.3 years, there appeared 
to be general improvement (not statistically 
significant, however, and not inconsistent with 
the general “regression toward the mean”’ fre- 
quently observed in retesting with the MMPI). 
There was only one statistically significant 
reduction in scale mean over the period of 
therapy. That was on Hy Obvious (T: 2.07, 
p < .05), which, since it is an isolated find- 
ing and inconsistent with other data, might 
well have been the result of sampling error. 

Group C (short-term, still in therapy) was 
also tested before and during treatment. After 
an average 14 months in therapy, there was 
no significant alteration on the MMPI scales. 
There was a tendency toward general minimal 
improvement, insignificant, however, with a 
significant drop in D Obvious (T: 2.33, p < 
.05) which, again, can be attributed to sam- 
pling error. 

On pretesting, there were no significant dif- 
ferences between short-term terminated veter- 
ans (Group D) and short-term nonterminated 
(Group C), on any MMPI scales except Hy 
Obvious (T: 2.39, p < .02). When compared 
with long-term clinic patients (Group B), the 
terminated patients (Group D) also appeared 
not to be significantly different on any scales 
except Mf (T: 2.73, p .05), with the termi- 
nated patients higher. 

Long-term and short-term clinic patients 
(Groups B and C) were also compared on 
pretesting. Significant differences were found 
on Hs, Hy, and Hy-Obvious, with long-term 
patients having the higher scores. This sug- 
gests a greater concern with physical and 
health problems among the long-term patients 
which might, in part, be accounted for by the 


differences in ages between the two groups. 
Tests of variance between all groups also 
yielded generally negative results. 

Since the data suggested that no greater 
benefits were reflected in the group several 
years in psychotherapy, over those several 
months in treatment—and since the depend- 
ency of the patient (as measured by the 
Navran De scale) appeared in no measure 
related to the length of time spent in therapy 

other possible explanatory variables needed 
to be explored. 

To examine the influence of therapists on 
the duration of therapy, two samples of thera 
pists and their patients were studied to de- 
termine the distribution of long-term patients 
among therapists. Tables 2 and 3 summarize 
this data. The first sample consisted of seven 
therapists and 72 patients, following therapy 
termination. 

Using the data from Table 2, 19% of the 
patient population spent over 20 sessions in 


Table 2 


Relationship Between Therapist and 


Number of Interviews 


Mn No % 
otal 
Thera No. of ul 


pist Patients 


Sessions Patients 


Patients 


over 20 over 20 


Therapy 


Sessions Sessions 
15 10 2 13° 
13 40 7 54% 
10 5 oor 
i8 7 06% 
19.2 20% 
1% 


6 719, 


S 
5 
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Table 3 


Relationship Between Therapist and Length of Therapy 


Total Mn. 
No. of Mos. in 


Therapist Patients Therapy 


B 29.67 
12.30 
23.61 
17.42 
16.69 


A : 25.60 


( 
I 
E 
I 
G : 14.90 
H 3 29.61 


psychotherapy. Using this percentage as a 
base line, three therapists had more of their 
patients in therapy over 20 sessions, and four 
therapists with fewer. A chi-square test of 
the number of long-term patients of 3 long- 
term therapists vs. four short-term therapists 
yielded a chi-square ratio of 9.69, significant 
at the .01 level of confidence with one degree 
of freedom. 

A second sample consisted of eight thera- 
pists and 130 patients, all in treatment at the 
time of this study. This sample was somewhat 
more highly controlled: Only those patients 
who were being seen by full-time staff mem- 
bers with roughly equivalent training and ex- 
perience were selected. Of the therapists, three 
were psychiatrists, two were psychologists, 
and three were social workers. 

Table 3 summarizes the data, including the 
number of patients, both the mean and me- 
dian months in therapy (rather than sessions 
this time), the percentages of patients over 
two years, and the percentages of patients 
over three years. 

As can be seen from the table, there is wide 
variation in the percentages of patients seen 
for two years or longer. There does not ap- 
pear to be a concentration of “long-term” pa- 
tients with any particular discipline. In the 
first group of therapists, all three “long term- 
ers” were psychologists; in the second group, 
one was a psychiatrist, one a social worker, 
and two psychologists. 

Dropping out therapists A and B (because 
of the low Ns), the total number of patients 
seen by the remaining six therapists is 122 


No. over 
3 Yrs. 


with a total of 2,394 therapy months and a 
mean of 19.6 months in therapy per patient. 
Total percentage of patients in treatment over 
two years is 27.9. Total percentage of patients 
in therapy over three years is 13.1. Using the 
latter again, as a rough cutting point, two 
therapists (D and H) have percentages of 
long-term patients greater than this. Thera- 
pists D and H account for 78% of the long- 
term patients in therapy. Therapist H alone 
accounts for 67% of all long-term patients 
currently being seen in the Mental Hygiene 
Clinic by full-time staff members. 

A chi square between numbers of patients 
treated by the two groups of therapists yields 
1 ratio of 15.9, significant at the .01 level of 
confidence, with one degree of freedom. In 
the second sample (the data were not readily 
available for the first sample), the propor- 
tions of diagnostic classes falling to each 
therapist do not appear to be significantly 
different. The percentage of diagnosed psy- 
chotics treated by the entire group of thera- 
pists was 27.7 and for the long-term thera- 
pists, 28.5. All other members of the patient 
group carried psychoneurotic diagnoses. 


Discussion 


The data presented suggest that, insofar as 
the MMPI and its auxiliary scales are able to 
assess them, long-term therapy shows few, if 
any, advantages over short-term therapy. 

Further, the data suggest that the majority 
of long-term patients can be accounted for by 
a minority of the therapists, making it highly 
desirable to determine whether: 
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1. Certain therapists are, purposely or otherwise, 
assigned chronic, potentially interminable patients be- 


cause of their “special talents” in dealing with them; 
or 


2. The therapist, in his relationship with the pa- 
tient, in some way encourages “interminability” be 
cause of difficulties in formulating goals, or in re- 
linquishing relationships. 


The possibility remains that there may be 
something inherently (and untestably) differ- 
ent in patients who become interminable in 
psychotherapy, and something that transcends 
rough diagnostic categories and other dimen- 
sions of behavior that are generally studied. 
However, it is also reasonable to examine the 
other half of the therapeutic relationship, as 
has been done previously (Auld et al., 1954; 
Myers et al., 1955; Myers et al., 1954; Schaf- 
fer et al., 1954) to a limited degree, to de- 
termine not only how experienced therapists 
differ from inexperienced therapists in rela- 
tion to termination problems, but how per- 
sonality types or needs within the therapists 
themselves affect therapy. Further investiga- 
tion is needed of “interminability” qualities 
in therapists, since our data suggest that 
eclectic long-term therapy may be neither 
economical nor particularly beneficial. 

When four judges roughly predicted who 
the “long-term” therapists in the study would 
be, their pooled rankings correlated .79 with 
the criterion, suggesting a predictable dimen- 
sion in the area of “dependency-nurturing.” 
The judges characterized the long-term thera- 
pists in these ways: therapist primarily de- 
sires to “help,” and this feeling can be sus- 
tained indefinitely; tends to personalize rela- 
tionship; tends to aim for marked changes in 
very sick patients; desires to succeed with in- 
tensive therapy; and needs to feel appreciated 
and effective (as a person and as a therapist). 
None of the comments made by the judges 
suggested that the therapists were dealing 
with chronic patients who required intermi- 
nable support. 

The results of this study point to the 
need for careful re-examination of therapeutic 
goals. Even in the event that concentration 
of interminable patients with a few therapists 
can be accounted for by “assignments of par- 
ticularly chronic patients,” the question of in- 
terminable treatment as a treatment of choice 


for these patients needs further inspection. 


Our tentative conclusion, that therapists them- 
selves may be responsible for the intermi- 
nability of treatment, places even greater re- 
sponsibilities on the professions who prepare 
psychotherapists for treating chronic patients. 
It seems to us likely that psychotherapeutic 
practice today contains self-defeating concepts 
which may be not only hampering to the suc- 
cess of treatment, but potentially harmful to 
its clients. 
Summary 


1. Sixty-six patients were divided into four 
groups, according to the amount of time spent 
in therapy. Two groups were described as 
“long-term,” and two as “short-term.” 

2. Follow-up psychometric findings revealed 
insignificant differences among the groups ini- 
tially similar, suggesting that length of time 
in therapy does not correlate with improve- 
ment. 

3. Two samples of therapists indicated that 
the great majority of long-term patients were 
being seen by a small minority of the thera- 
pists. A likely reason appears to be failure on 
the part of “long-term” therapists to ade- 
quately formulate therapy goals, and to im- 
personalize the therapeutic relationship. 


Received May 2, 1958 
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The relationship between anxiety and the 
process whereby a psychotherapy patient be- 
comes aware of and eventually verbalizes re- 
pressed material is a matter of both theoreti- 
cal and practical interest to the therapist. The 
present status of psychological theory with 
respect to this problem allows for several 
different and contradictory predictions about 
this relationship. 

It is perhaps reasonable to assume that 
when certain material is repressed, the re- 
pressor experiences anxiety associated with 
this material to the extent that the repression 
is incomplete. That is, with complete repres- 
sion, internal anxiety-producing cues are not 
present and, accordingly, an anxiety response 
is not made. As repression becomes less com- 
plete (more and more anxiety-producing cues 
appear), more and stronger anxiety responses 
are made. From this point on, it is possible 
to pose reasonable but alternative predictions 
as to the relationship between anxiety and the 
process of “lifting” a repression. 

On the one hand is the view implied in 
some psychoanalytic writings that the achieve- 
ment of full realization (“insight”) into the 
repressed material results in relief or anxiety 
reduction. 

On the other hand, one might expect that 
the increased number and clarity of the anx- 
iety-producing cues, associated with less and 
less complete repression, leads to even greater 
anxiety as the individual approaches complete 
awareness of the formerly repressed material. 

t This research was performed while J. E. Gordon 
was Resident Lecturer in Psychology at the Univer- 
sity of Wisconsin, supported by a U.S.P.HS. grant 


Further, overt verbalization of the repressed 
material should involve even more fully con- 
stituted anxiety-producing cues and, accord- 
ingly, greater anxiety than is present during 
awareness without overt verbalization. 

To complicate the problem further, one 
must introduce the possibility of extinction of 
the learned association between cue and anx- 
iety response. Such extinction is likely to be- 
gin shortly after awareness or overt verbali- 
zation has occurred in psychotherapy. 

In view of the above considerations it does 
not seem appropriate to state directional hy- 
potheses in the present study, which was de- 
signed to explore empirically the relationship 
between anxiety and the “lifting” of a repres- 
sion, as the threatening material moves from 
a state of repression through awareness with- 
out verbalization (suppression) to overt ver- 
balization. 

Research which might clarify this relation- 
ship has been made difficult by the nature of 
repression. An experimenter cannot know what 
is repressed until it is no longer repressed, at 
which time it is too late to measure anxiety 
associated with it. However, a set of pro- 
cedures used in an earlier study (Gordon, 
1957) has been modified to make possible 
measurement of anxiety in a situation in 
which repression and suppression of known 
content is experimentally induced. Thus meas- 
urement of anxiety during repression, suppres 
sion, and verbalization of experimenter-con 
trolled material is possible 

A state of repression is assumed to exist 
when a person fails to produce either overt or 
covert cues (usually verbal) to which anxiety 
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responses have been attached, where the pro- 
duction of such cues is appropriate. For the 
purposes of this research, posthypnotic in- 
structions were used for inducing this condi- 
tion. Posthypnotic amnesia was created by 
the instruction to “not think about” a par- 
ticular area of experience. The area of experi- 
ence selected was that of conflict with one or 
both parents. It was assumed that anxiety is 
usually associated with such experiences, so 
that the words used to symbolize such experi- 
ence also serve as cues for anxiety.’ 

Suppression is defined as an awareness of 
an area of experience together with the mo- 
tivation to not verbalize about it overtly. The 
experimental manipulations involved hypnotic 
instructions that the subject would think 
about and recall her conflicts with her par- 
ents, but would not want to talk about them. 

Verbalization was defined as conversation 
about parents and/or conflicts with parents 
with the interviewer. The experimental ma- 
nipulations involved hypnotic instructions to 
want to talk about conflicts with parents with 
the interviewer. 

Anxiety was defined in terms of galvanic 
skin conductance. Although there is disagree- 
ment about the nature of anxiety and the 
most valid measures of it, there is consider- 
able evidence that skin conductance, which 
reflects changes in sympathetic nervous sys- 
tem activation, is associated with states of 


2One may question these procedures as satisfying 
the definition of Freud’s concept of repression as a 
defensive maneuver. The instructions to “not think 
about,” while omitting specific mention of avoidance 
motivation, however, do presumably produce a phe- 
nomenon in which previously “conscious” material is 
no longer verbalizable (i.e., becomes “unconscious”) 
even though this material later becomes available for 
verbalization. Thus we are not dealing with forgetting 
or extinction. The process in the subject by which 
material is for a time rendered unconscious is better 
described by the term “repression” than any other 
term in current usage. As far as defensive motivation 
is concerned, it is assumed that because the conflict 
material used in this study is usually unpleasant to 
most people, then anxiety is assumed to be associated 
with the verbal conflict symbols. There is reason to 
regard such associated anxiety as a drive or motiva- 
tional factor, the reduction of which can reinforce 
the responses which led to the anxiety reduction. In 
this sense, the instructions to “not think about” an 
unpleasant experience are considered to be analogous 
to defensively motivated repression 
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general emotional arousal or mobilization 
(Schlosberg, 1954). Emotional arousal may 
be a somewhat broader concept than anxiety, 
but lacking precise operational distinction be- 
tween anxiety and this more general concept, 
the skin conductance measure was accepted 
as the operational definition of anxiety in this 
study. 


Procedure 


Subjects. Ss were 12 female undergraduate 
students at the University of Wisconsin. These 
Ss were selected from a group of 20 females 
who had already been trained and screened 
for hypnotic susceptibility, who agreed to 
serve in this research. The group of 20 from 
which they came was screened from an initial 
group of 44 females who volunteered for “an 
experiment on hypnosis.” Training and screen- 
ing procedures consisted of three successive 
hypnotic sessions, in each of which a more 
“difficult” posthypnotic suggestion was given, 
and the response tested. The final criterion 
for selection of Ss was complete posthypnotic 
amnesia by the end of the third training and 
screening session. 

Control. After the third session, appoint 
ments were made with Ss for a control inter- 
view. Immediately preceding this interview, S 
was told that electrodes would be attached to 
her fingers in order to record “changes in the 
electrical activity” of the skin, and S was re- 
assured that she would experience no electri- 
cal shock. S was then introduced to the inter- 
viewer who attached the electrodes to S seated 
in a chair at the interviewer’s desk. Control 
interviews consisted of 15-minute nondirec- 
tive interviews conducted by a trained clini- 
cal psychologist. Ss were told that they could 
talk about anything they cared to, that the 
topic of conversation was completely up to 
them. The purpose of this interview was to 
provide a period of adaptation to the GSR 
device, and to obtain a measure of base level 
conductance against which to compare the 
conductance measure obtained under the ex- 
perimental conditions. 

At the conclusion of the control interview, 
each S was again seen by the principal in- 
vestigator, who asked her to fill out the Psy- 
chotherapy Reaction Questionnaire, a scale 
developed by Ford (Ashby, Ford, Guerney 
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& Snyder, 1957) to tap defensive reactions 
and positive or negative attitudes toward the 
therapist. 

Experimental conditions. Two experimental 
groups were formed. The only difference be- 
tween these groups was in the order of the 
experimental conditions. One group, desig- 
nated RVS, was to receive instructions de- 
signed to produce repression, verbalization, 
and suppression in that order. The other 
group, designated RSV, was to be given in- 
structions designed to produce repression, sup- 
pression, and verbalization in that order. 

Following the control interviews, Ss were 
appointed in random order to the two groups 
for the fifth and final sessions. Ss were hyp- 
notized and given the following instructions: 


Now, as you continue to sleep, I want you to re- 
call in your imagination some of the occasions on 
which you have into conflict with either or 
both of your parents. Think of times when you 
might have had arguments, or when you felt either 
your mother or your father were too strict, or when 
you might have felt that you were unfairly treated 
or not being understood 
casions in 


come 


Review some of these oc 
memory. See them in your mind’s 
eye. You don’t need to tell me about them—just 
think about them yourself. I'll give you a minute or 
two in which I'll be silent to give you a chance to 
envision yourself in those situations. Feel just ex- 
actly the way you felt at those times. Kind of re 
live those experiences in your imagination now. Just 
think about them for a little while 


your 


Conflict with parents was selected as the 
area of experience for this research because it 
is a fairly universal experience, and thus likely 


to be realistic for each S, and is one which is 


usually attended by anxiety. The procedures 
thus have the advantage over artificially in- 
duced neuroses of permitting some control 
over a true and meaningful experience in S’s 
past. 

Following these instructions, Ss in the RVS 
group were instructed as follows: 


Now, when you wake up, all those experiences 
you've been thinking about will have completely left 
your mind. You won’t be thinking of them at all 
They'll be the farthest things from your mind. In 
the beginning of your interview with Dr. __—, he'll 
click a key three times. Just ignore that. It doesn’t 
mean anything. But later on, when he clicks the key 
gain, all these thoughts and experiences with your 
father mother or both, and your feelings about 


those experiences, will come to mind. You'll begin 
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to think about them again. You can talk about the 
feelings and experiences that are on your mind 
You'll want to talk them over with Dr . Later 
on, Dr. __— will click the key again. When he does, 
it'll occur to you that you shouldn’t really talk to 
him about your experiences and feelings toward your 
parents, and you won't want to talk about them 
anymore, although they will 


These instructions then summarized 
posthypnotic amnesia for the instructions in 
duced, and S awakened. 

For the RSV group, the instructions were 
substantially the same, except that instruc- 
tions for suppression were given before the 
instructions for verbalization 

Upon awakening, S was told that she was 
to be interviewed by Dr and that 
throughout the course of the 45-minute in- 
terview, she would have electrodes strapped 
to two fingers. S was told that, as in the con- 
trol interview, she could talk about anything 
she cared to. S was then brought to the inter- 
view room, introduced to Dr 


still be on your mind 


were 


and the 
electrodes attached. The interviews began in 
a standard manner, with the interviewer tell- 
ing S that the interview would be about the 
same as the one she had before and that she 
might start off by telling something about 
herself. From that point on, the interview re- 
mained within the 
{ll interviews 


framework 
recorded. At the 
interview, S returned to 
the experimenter who again administered the 
Psychotherapy Reaction Questionnaire, dis 
abused S of the hypnotic instructions, 
told her of the purpose of the study. 
The interviewer did not know beforehand 
whether an S was in the RVS or RSV group 
GSR recording. Skin conductance measures 
were obtained by using an AC circuit de 
signed by Grant (1946) and dry silver elec 
trodes bound to the palmar surfaces of two 
fingers of S’s left hand. Continuous ink re- 
cordings of S’s resistance throughout the ses 


nondirective 
were 
conclusion of the 


tape 


and 


ion were obtained by feeding the output of 
Ele trie 
Resistance scores were 


the GSR apparatus into a General 


Photoelectric Recorder 


obtained by halving the difference between 


the low and high points in one-minute sec 


tions of the ink recordings, and adding this 


to the low point within each one-minute in 


terval. The conductance scor 


es for data analy 
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Fig. 1. Distribution of references to parents and 
conflict with parents 


sis were the reciprocals of these resistance 
measures. 
Results 


As a check on the validity of the experi- 
mental procedures, the interview tape record- 
ings were scored in 30-second intervals for the 
presence of reference to parents, and to con- 
flict with parents. Each interval was scored 
plus or minus for the presence or absence of 
such references during that interval. No at- 
tempt was made to score for magnitude of 
references, or to frequency within intervals. 
Figure 1 shows the distribution of plus scores 
for the RVS and RSV groups. It is apparent 
from Fig. 1 that the Ss did follow the hyp- 
notic instructions, as far as verbalizing is con- 
cerned.* One S in each group failed to follow 
the instructions; neither made any reference 
to parents, with or without conflict, through- 
out the course of her interview. These two Ss 
were therefore dropped from further analysis 

Figure 2 presents the conductance scores of 
both groups over all conditions.* The abscissa 


The lines marking the boundaries of the experi 
mental conditions are approximate. The interviewer 
varied somewhat in his timing of the signals, so as 
not to interrupt an S in a flow of conversation. The 
interview sections are therefore not strictly compa- 
rable from S to S in terms of length. The boundary 
lines in this figure are drawn at the times when the 
signals were most frequently given 

*As was noted in connection with Fig. 1, the 
length of the experimental conditions varied some 
what from S to S. The number of intervals reported 
in this figure and used in the statistical analyses was 
the maximum number of intervals common to all Ss 
For several Ss, therefore, the last one or two in 
tervals in some conditions were dropped from th 
analyses 


represents number of two-minute intervals 
from the beginning of the particular experi- 
mental condition. As noted above, the GSR 
records were scored in one-minute intervals. 
These data were collapsed into two-minute 
intervals by adding the scores together in 
successive pairs of one-minute intervals. The 
height of the curves therefore represents the 
RVS and RSV means of conductance scores 
(in micromhos) summed over two one-minute 
intervals. 

It may be seen from Fig. 2 that there is a 
general increase in conductance across the en- 
tire time period. The levelling-off of the con- 
ductance, usually interpreted as adaptation, 
which is commonly found in GSR records 
after the first 15 minutes of recording, is not 
present in these data. That the over-all in- 
crease in height is not a function of the par- 
ticular order of the experimental conditions 
is suggested by the data on Suppression and 
Verbalization. The conductance curve for the 
last experimental condition is higher than for 
the next to last, regardless of whether the last 
was Suppression or Verbalization. 

The GSR data were therefore analyzed for 
differences in shape of the conductance curves 
rather than for differences in mean conduct 
ance levels. It is thus possible to draw con- 
clusions about the relationship between the 
ndependent variables and the growth of anx- 
iety, although level of anxiety at any par- 
ticular point must be ignored. Figure 3 pre- 
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sents the conductance curves of all Ss, com- 
bined by experimental conditions. The units 
are the same as in Fig. 2. 

Grant’s (1956) extension of Alexander's 
trend test was applied to these data. For each 
5, a difference was found between her con 
ductance levels in two-minute intervals of one 
condition and the comparable two-minute in- 
tervals in a comparison condition. Thus a set 
of difference curves was generated for each 
pair of conditions which were to be compared 
with each other. Each difference curve was 
tested for the significance of its difference 
from a curve of zero slope. This then tells one 
whether there is a difference in the slopes of 
the curves representing the different condi- 
tions to be compared. Tables 1, 2, 3, and 4 
report the results of these analyses. 

Table 1 indicates that under the Repression 
condition, Ss’ conductances were increasing at 


Table 1 


Analysis of Variance of Trend of Differenc« 


Between Repression and Control* 


Mean 


oquare 


Between ir 
Between ind 
Between in 
Over-all slope 
Over-all quadratic 
Over-all « 


Table 2 
Analysis of Variance of Trend of Differences 
Between Repression and Suppression 


Mear 


source square 


Between ind slopes 
Between ind. quadrati 
Between ind. cubics 
Over-all slope 
Over-all quadratic 
Over-all cubic 


a faster rate than they were during the Con- 
trol interviews. It appears that anxiety in 
creases as S approaches the point of aware- 
ness, and the repression mechanism becomes 
less effective. 

Tables 2 and 3 compare Repression with 
Suppression and Verbalization. The results do 
not reveal any significant differences between 
the conductance curves in Repression and Sup 
pression. The Repression-Verbalization differ 


Table 3 


Betwee 
Between ir 
Betweer 
Over-a 
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ence curve also does not yield a significant 
slope, although there is a tendency for the 
Repression curve to be somewhat steeper 
than the Verbalization curve. 

Table 4 reports the comparison of Suppres- 
sion and Verbalization. The significant differ- 
ence found indicates that conductance meas- 
ures obtained under Suppression increase at a 
greater rate than those obtained during Ver- 
balization. Figure 3 reveals that the Verbali- 
zation slope is almost flat, whereas the Sup- 
pression slope is one of the steeper slopes 
obtained. Thus it is found that anxiety ac- 
cumulates or builds up at a faster rate during 
Suppression than during Verbalization of dis- 
turbing material. 

The differences between the RSV and RVS 
groups in the questionnaire of attitudes to- 
ward the therapist yielded t = 1.64 (p > .05) 
The mean change in the RSV group was 
+3.6, which is in the direction of more 
positive attitudes; the mean change in the 
RVS group was —5, which is in the direction 
of more negative attitudes; oz; = 5.25. Al- 
though the differences are not significant, due 
to the great variability among the Ss, the re- 
sults suggest a tendency for RSV Ss to feel 
more positively toward the therapist than the 
RVS Ss. This suggests that Ss whose most re- 
cent experience has been one in which they 
revealed, rather than hid from the therapist, 
some personally threatening material may feel 
more positively toward the therapist. 


Discussion 


The most striking outcome of this study is 
the finding that there is never a downward 
turn in the absolute measure of anxiety dur- 
ing the 45-minute experimental session. This 


suggests that the lifting of a repression, 
whether it included Suppression or Verbaliza- 
tion, or both, is accompanied by a fairly con- 
sistent rise in anxiety. An absolute reduction 
in anxiety, for whatever reason, does not seem 
to occur during the first 30 minutes or so after 
the S first becomes aware of the repressed ma- 
terial. It is of interest to note that the two 
Ss who failed to comply with the posthypnotic 
instructions by never verbalizing about par- 
ents in any fashion were the only two Ss who 
did not show this over-all increase in conduct- 
ance. One of these Ss had a decreasing con- 
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ductance curve, and the curve of the other S 
was about level. Experience with GSR indi- 
cates that this upward trend is not neces- 
sarily characteristic of interviews of compa- 
rable length. This phenomenon thus appears 
to be associated with the effects of the hyp- 
notic instructions. One possible explanation 
of the continuing rise in conductance may be 
that anxiety associated with parental conflict 
accumulates throughout the time that the Ss 
are forced by the hypnotic instructions to 
deal with this aspect of their experience. The 
over-all upward trend does tend to level off 
during Verbalization. One may account for 
this by assuming that extinction of the asso- 
ciation between cue and anxiety response oc- 
curs when anxiety-producing material is ver- 
balized in an accepting atmosphere. From this 
point of view, we might expect the curve 
eventually to turn downward if sufficiently 
long periods of Verbalization were maintained 
until the verbal cue-anxiety association is ex- 
tinguished. Perhaps the 15-minute period was 
not sufficient to get a full indication of the 
degree to which extinction could occur dur- 
ing Verbalization. 

A simpler account of the change in slope 
during Verbalization might be that the in- 
crease in anxiety is retarded only when the S 
is talking about the anxiety-arousing mate- 
rial. In this sense, the anxiety curve begins to 
level off only when there is congruence be- 
tween the Ss’ experiencing of the material, 
their awareness of the material, and their 
verbalization of it. This account also suggests 
that, had there been more time in which S$ 
could experience this congruence, the anxiety 
might have reduced. When there is not this 
complete congruence, as in the Repression 
and Suppression conditions, anxiety consist- 
ently increases. 

Given this over-all increase in conductance, 
which appears to be unrelated to the particu- 
lar experimental conditions, except possibl) 
for Verbalization, one may still compare the 
conditions in order to discover which ones 
contribute most heavily to the growth of the 
anxiety. The results of such comparisons in- 
dicate that repressing Ss generate anxiety at 
i faster rate than they do in the nonrepressing 
control condition. One cannot decide from 
these data whether the increasing slope in re- 
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pression is caused by the imminent cessation 
of repression, or by a simple anticipation of 
the signal denoting the start of another con- 
dition. The control interview was not fol- 
lowed by another condition, as was the case 
with the Repression section. However, an ex- 
amination of the curves in Fig. 2 suggests 
that increases in conductance may not be 
solely determined by anticipation; the RVS 
group does not have as rapid an increase in 
conductance as the RSV group during the 
second interview section, even though there 
is still a third interview section for both 
groups to anticipate. It is suggested that what 
is being anticipated plays at least some part 
in the anticipation response. This further 
suggests that some anxiety-arousing cues are 
being produced in the Ss even though they 
are repressing, as defined by the hypnotic in- 
structions, and that these cues increase as the 
point of awareness approaches. Since the Ss 
are not overtly verbalizing about the induced 
threat or about the signal which they may be 
anticipating, it must be assumed that the 
anxiety-arousing cues are being produced 
covertly. If we assume that the Ss were not 
thinking about the threat or the approaching 
signal, according to the hypnotic instructions, 
we must conclude that the anxiety-producing 
cues were being produced without the Ss’ 
awareness 

This raises some questions about the na- 
ture of awareness. According to Dollard and 
Miller (1950), repression exists when an indi- 
vidual fails to think (produce verbal cues, 
usually) because of the association between 
these cues and anxiety. This is essentially a 
learned avoidance response. If such were the 
case, one would expect little or no anxiety in 
repressing Ss. This, of course, is not what was 
found. Our data, indicating increasing anx- 
iety during Repression, suggest that some 
anxiety-arousing cues were being produced 
when the Ss are assumed, on the basis of the 
hypnotic instructions, to be unaware of the 
threat. Thus there is evidence for the pres- 
ence of anxiety-producing cues without aware- 
ness. Dollard and Miller’s hypothesis that un- 
awareness or unconsciousness is defined in 
terms of the absence of such cues is there- 
fore inconsistent with the analysis based on 
our data. It is suggested that awareness be 
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defined in terms of some other secondary re- 
sponse to the covert (verbal) anxiety cue- 
producing responses which the unaware Ss ap- 
pear to be making, and that it is these other 
responses (perhaps self-related evaluations) 
which are not being made by repressing Ss. 
That is, awareness may be defined in terms 
of some self-related evaluations which the in- 
dividual may or may not make as responses 
to internal, usually verbal cue-producing re- 
sponses, rather than in terms of the cue-pro- 
ducing responses themselves. 

Hypnosis may be thought of as an indirect 
way of producing the condition of not being 
aware of the covert cues associated with anx- 
iety. There is no guarantee that the Ss were 
indeed unaware of the anxiety-producing cues, 
namely, thoughts about parental conflict. If 
one is willing to accept the validity of the 
posthypnotic instructions in this respect, then 
the rather interesting conclusion must be 
drawn that anxiety increases with equal ra- 
pidity whether S is aware of the covert anx- 
iety-producing cues or not, since the conduct- 
ance curves for Repression and Suppression 
do not differ in slope. This finding that anx 
iety continues to rise in the Suppression con 
dition suggests that awareness or insight, of 
itself, is not sufficient to reduce anxiety. 

At the same time, an account of the rela 
tionship between anxiety and the lifting of 
repression which would predict a direct rela- 
tionship between anxiety and availability of 
anxiety-producing cues would have some diffi- 
culty with these data. With initial verbaliza- 
tion and its profusion and clarity of cues, we 
should expect an even greater increase in the 
anxiety measure. In contrast we find that it 
is only during Verbalization that the increase 
in anxiety tends to slow down 

This reduction in anxiety increase during 
Verbalization may have a counterpart in the 
positive feelings toward the therapist which 
the RSV Ss tend to show to a greater extent 
than the RVS Ss. It seems probable that the 
verbalization section, occurring last for the 
RSV Ss, leaves the S with a more positive 
feeling because the S has been experiencing 
a lessening of the anxiety increase just prior 
to her rating of the therapist. In contrast the 
increase in anxiety associated with the last 
condition—Suppression—for the RVS Ss may 
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be associated with the tendency of these Ss to 
feel less positive toward the therapist. 

Certain qualitative aspects of the Ss’ be- 
havior in the interviews may provide a clearer 
picture of the nature of these interview ses- 
sions. In all respects, Ss’ verbal behavior was 
natural; it is doubtful that the most insight- 
ful psychologist would discover, from listen- 
ing to the tape recordings, that Ss were per- 
forming according to hypnotic suggestions. 
Of particular interest is the manner in which 
Ss responded to the signal denoting the be- 
ginning of a new experimental condition. In 
no case was there a verbal response relating 
to the signal itself. Some Ss lapsed into silence 
for a few seconds, and then began verbalizing, 
usually with a change to subject matter ap- 
propriate to the new condition. A frequent 
remark from Ss who had been in the Verbali- 
zation condition when the signal was given 
marking the beginning of Suppression was 
“Well, let’s talk about something pleasanter 
or “I guess I shouldn't bore you with these 
personal problems.” During Suppression sec- 
tions, particularly in the RSV group, one 
notes frequent references to the parental con 
flicts of others—friends, relatives, etc., and 
occasionally a spontaneous denial of personal 
conflicts with parents. 

One recording was particularly illuminating 
in the manner in which it reveals the develop- 
ment of associations to the threatening mate- 
rial. The S was in the RSV group. The major 
topic of conversation during Repression was 
S’s interest in a film on intellectual deficiency 
and brain pathology she had recently seen in 
psychology lecture. This film reminded her of 
her friend’s mother, who suffers from multiple 
sclerosis. This conversation was continued in 
the Suppression section, where the major em- 
phasis was on the emotional climate of the 
friend’s home, in relation to the mother’s ill- 
ness. S stressed the frequent conflicts between 
her friend and her friend’s father, growing out 
of the continual stress at home. This con 
tinued until the Verbalization section began, 
in which S discussed her own conflicts with 
her parents. She introduced the topic by say- 
ing, “Of course, lots of people have problems 
with their parents, even when there isn’t that 
kind of sickness and tension.” Thus the dis- 
cussion of the psychology film seems to have 
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been closely associated with, or at least led 
directly to, a discussion of S’s own problems. 
This may suggest that therapists be cautious 
in deciding that any particular topic is as 
irrelevant as a discussion of a film on brain 
damage at first appears. It is the ability to 
produce behaviors such as these which be- 
come intelligible only when the experimenter 
has knowledge and control of the antecedent 
conditions, that makes the experimental pro- 
cedures used in this research of particular 
value. 


Summary 


An experiment was performed to study the 
effects on anxiety, as measured by GSR re- 
cording, of repression, suppression, and _ ver- 
balization of threatening material. Ten se- 
lected and trained undergraduate female Ss 
were stimulated to recall conflicts with their 
parents under hypnosis, and were given post- 
hypnotic suggestions to “not think about” 
(Repression), “think about but not talk 
about” (Suppression), and “talk about”’ (Ver- 
balization) conflicts with parents to the inter- 
viewer, who conducted a nondirective type 
interview for 45 minutes with each S. Each 
condition occupied 15 minutes of the inter- 
view, with S responding to signals demarcat- 
ing the beginning of each condition as in- 
structed under hypnosis. Skin conductance 
was recorded continuously throughout the in- 
terviews, and a scale of attitudes toward the 
therapist given once at the end of a 15-minute 
control interview and again at the end of the 
45-minute interview, constituted the depend- 
ent variables. Skin conductance measures were 
analyzed in terms of differences in slope. The 
findings were as follows: 

1. There was a consistent over-all increase 
in conductance throughout the experimental 
indicating a continuous growth in 
inxiety regardless of the order of conditions 


session, 


The increase in conductance was more 
ipid under Repression than during the con- 
trol interview. 

3. Conductance slopes during Repression 
and Suppression were not found to differ sig- 
nificantly. 

+. The conductance slopes during Suppres- 
during 


n were significantly steeper than 
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Verbalization, in which the slopes tended to 
flatten. 

5. Ss whose last interview section was Ver- 
balization showed a tendency toward more 
positive shifts in attitudes toward the thera- 
pist than Ss whose last interview section was 
Suppression. However, this difference was not 
significant. 

Received May 9, 1958 
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Tomkins (1947) has introduced the con- 
cept of remoteness between the TAT narrator 
and the TAT figures as an important inter- 
pretive device. This concept assumes that a 
hierarchy of impulse acceptance can be es- 
tablished for the narrator. For example, Pio- 
trowski (1950) has stated: . the most 
acceptable drives are projected into TAT fig- 
ures who resemble the testee by age, sex, race, 
social status, etc. Less acceptable drives are 
ascribed to figures of the same sex but of 
different age. Actions which are still less ac- 
ceptable are projected into figures of the op- 
posite sex. Tendencies that possess a still 
higher degree of unacceptability are assigned 
to figures both of opposite sex and of differ- 
ent age” (p. 108). Van Lennep (1948, 1951) 
also has written extensively on this general 
theme and regards the individual who utilizes 
projection as manifesting an attempt to “dis- 
tance” himself from ego-threatening self-at- 
tributes. 

The present study was designed to test the 
validity of Piotrowski’s assumption, and the 
following hypothesis was formulated for this 
purpose: The less acceptable certain behavior 
is to the narrator, the more he will attribute 
such behavior to TAT figures dissimilar to 
himself along a continuum of age and sex. 


Method 


Twenty-one male neuropsychiatric patients 
at the Denver Veterans Administration Hos- 
pital were used as Ss. They were selected from 


1 The authors wish to express their appreciation to 
Robert Fadeley, John Thompson, and Virgil Willis, 
who assisted in testing some of the subjects 

2 Now at Harvard University 


pital, Denver, Colorado 


patients referred to the Psychology Service for 
diagnostic testing. No psychotic patients were 
used since it was felt that there would be a 
higher probability of their misunderstanding 
the task. 

Ss were asked to write TAT stories using 
Cards 1, 4, 6GF, 7BM, 7GF, and 13F. These 
cards were selected since they include ap- 
proximately an equal number of males and 
females (five and six, respectively). Further, 
the figures on these cards represent a wide 
age range. The female figure in the back- 
ground of Card 4 was not used, as only two 
Ss referred to it. 

Ss wrote the stories with the experimente: 
ibsent from the testing room. This procedure 
has been found by Bernstein (1956) to elicit 
freer expression of feeling in TAT stories. The 
following instructions were read to each S 
ind left with him in written form, after it 
was felt that he understood the nature of the 
task: 

This is a test of imagination, one form of intelli 
e. The cards which you have been given have 
tures on them. You are to look at them, one at a 
and write as dramatic a story as you can for 

ach one. Tell what has led up to the event shown 
in the picture, describe what is happening at the 
moment, what the characters are feeling and think- 

g, and then give the outcome. Try to spend about 

minutes on each story 

When you have finished writing the story, guess 
the age of each of the people in the picture and 
write the ages at the bottom of the paper upon 

hich you have written the story 


To test the hypothesis, it was necessary to 
quantify the variables of (a) acceptability- 
of-behavior for each TAT figure, and (6) the 


) 
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age-sex dissimilarity between S and each TAT 
figure. ? 

The acceptability-of-behavior of each TAT 
figure was measured by first classifying all 
the scoreable behavior in S’s stories accord- 
ing to the scheme of needs proposed by Mur- 
ray (1938). For example, if S wrote about 
one figure, “This man has just shouted angrily 
at the other person,” this behavior was classi- 
fied under the need, Verbal Aggression. After 
all the needs had been extracted from S’s 
stories, he was seen in a second session. He 
was given a pack of small cards, each of 
which contained a behavioral description rep- 
resenting one of the needs he had expressed 
in some story,® and asked (under the guise of 
this being another test) to rank-order these 
behavioral descriptions in terms of their ac- 
ceptability to him. Instructions were: 


In this test, read all the cards carefully. Then ar- 
range them on the table in a column according to 
h Ww accepta rhe the 
from your 


W hen y« 


feel is mos 


behavior described on each is 
point of view 

finish, th with the behavior you 

acceptable will be at the top of the 

column and the card with the least acceptable be- 
havior will be at the bottom. The rest of the cards 
in the column will be in order of their acceptability 

Think of “acceptable behavior” as the kind which 
you would be comfortable in claiming as your own 
the kind you feel is the best to uss 
ing 

Take your time and feel free to move the 
around until you have them in just the 
you want them 


card 


, generally speak- 


cards 


order that 


The rank numbers assigned to the needs S 
had expressed were used to compute an ac- 
ceptability-of-behavior score for each TAT 
figure. This score was found by summing the 
rank numbers of all the needs attributed to 
a particular figure. For example, if a figure’s 
behavior was described by three needs, the 
rank numbers given these needs were summed, 
and the sum became the acceptability-of-be- 
havior score for that figure. These scores for 
the eleven TAT figures were then rank-or- 
dered, thus arranging the figures in a hier- 
archy of acceptability-of-behavior. 

The second variable, dissimilarity between 
S and TAT figures, was quantified by order- 

8 For example, the description for the need, Verbal 


Aggression, was: “He makes fun of people, is sar- 
castic, and quarrelsome.” 


ing the figures onto a continuum of age and 
sex. Differences were computed between the 
age of S and the age he estimated for each 
TAT figure. The rank-order differences for 
the five male figures were assigned Ranks 1—5, 
and the age differences of the female figures 
provided Ranks 6-11. By this method, both 
age and sex differences were included in the 
dissimilarity continuum, as required by the 
hypothesis 

Finally, a rank-order correlation between 


the ranks of the acceptability-of-behavior 


scores and the dissimilarity ranks of the 11 
TAT figures was computed for each subject 


Results and 


Discussion 


Of the 21 Ss, 10 wrote stories in 
needs were attributed to each of the TAT 
figures. A rho correlation for each of these 
10 Ss was computed between the ranks of the 
acceptability-of-behavior 


which 


and age-sex 
the total 11 TAT fig 
This group is referred to as “nondis 
tanciators.” It will be noted that none of 
these correlations, shown in Table 1, are sig 
nificant. 


scores 
dissimilarity ranks of 
ures, 


\ rho correlation was computed for each 
of the who did not 
needs to all the figures in the 


remaining Ss attribute 


stories written 


Table 1 
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The correlation for each of these Ss is be; 
tween the ranks of the acceptability-of-be- 
havior scores and age-sex dissimilarity ranks 
of the TAT figures to which the particular S 
had attributed needs. Thus, the rhos from 
these 11 Ss are based upon the data from 
different numbers of TAT figures which vary 
from 5 to 10. These individual correlations 
also are shown in Table 1. Of these 11, 10 
are significant at or beyond the .05 level of 
confidence. This group of Ss is referred to as 
the “distanciators.” 

These findings focused attention upon the 
individual differences in distanciation, i.e., the 
fact that Ss who failed to attribute needs to 
all the TAT figures did distanciate, whereas 
Ss who attributed needs to all the figures did 
not. This raises the question of what subject 
variables may be producing such variance. In 
line with this, the length of hospitalization 
for the two groups was examined. It was 
found that the distanciators had been hos- 
pitalized for a mean period of 4.40 weeks 
while the nondistanciators had been hospital- 
ized for a mean period of 8.64 weeks. The 
difference in length of hospitalization between 
the two groups, using the Mann-Whitney U 
test, yields a U of 24 which, for the size of 
the two groups, is significant at the .025 level 
(The sigmas of the distanciators and non- 
distanciators are, respectively, 4.23 and 7.51.) 

In retrospect, this finding is logically con- 
sistent with some emerging theoretical formu 
lations which the authors are beginning to 
construct regarding the manner in which un 
acceptable behavior is handled. It would ap- 
pear that the degree of distanciation mani- 
fested is related to certain factors which are 
part of the situation in which S behaves. For 
example, the Ss in this study represent hos 
pitalized, emotionally disturbed individuals 
most of whom were currently having diffi- 
culty with their usual defenses of repression 
and denial. For some, it was the first time in 
a therapeutic environment * which typically 
encourages a frank examination of behavior. 
This, plus the experience of psychotherapy 


Since the hospital in which this study was con 
ducted is a teaching center, only patients with acut 
psychiatric conditions which are expected to respond 
to relatively 
mitted. 


short-term intensive treatment are ad 


Everett Pile, Walter Mischel, 


and Lewis Bernstein 


which most were receiving in some form, 
might operate to bring their needs closer to 
awareness. This possible factor, coupled with 
the reduction in fear of realizing and admit- 
ting the existence of many undesirable per- 
sonal characteristics could vary with the 
length of time in the situation (the thera- 
peutic environment). This possibility is con- 
sistent with the finding that the distanciators, 
hospitalized for a shorter length of time, 
failed to attribute needs to every TAT fig- 
ure. Their stories are thus more evasive, if 
we interpret this failure to attribute needs to 
all the figures in TAT stories as evasion. 
The results seem to indicate that the as- 
sumption set forth by Piotrowski holds, but 
only under certain conditions. The next task 
must be to study more fully the factors in 
the situation which comprise these conditions 
Further research is now in progress to deter 
mine whether differential stress experimen- 
tally generated by verbal cues affects the 
distanciation TAT 


degree of manifested in 


stories 
Summary 


This study tested an assumption of Pio- 
trowski that the less acceptable certain be- 
havior is to the TAT narrator, the more he 
will attribute such behavior to TAT figures 
dissimilar to himself along a continuum of 
ige and sex. Twenty-one male neurotic pa- 
tients at the Denver VA Hospital 
stories to six selected TAT cards, ar4 
mated the each TAT figure. These 
were scored for a set of standard 
During a second session, each S rank- 
ordered all the needs which he had attributed 
to the TAT figures, using a criterion of “per 
sonally acceptable behavior.” 

A rho correlation for each S was computed 
between the ranks of the acceptability-of-be- 


wrote 

esti 
age of 
tories 


needs 


havior scores and the age-sex dissimilarity 
ranks. Ten Ss wrote stories attributing needs 
to all the TAT figures; 
tions for these Ss was significant. Eleven Ss 
failed to attribute needs to all TAT figures: 


none of the correla- 


10 of the 11 
significant. 
These findings demonstrate that Piotrow- 
ski’s assumption is valid only under certain 
conditions. In the present study, length of 


correlations for these Ss were 





Remoteness of TAT Figures 


hospitalization appears to be a relevant vari- 


able. 
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MMPI DIFFERENCES BETWEEN PARENTS OF 
DISTURBED AND NONDISTURBED 
CHILDREN * 


SHEPHARD LIVERANT 
Ohio State University 


It is a widely held clinical notion that the 
parents of behaviorally disturbed children are 
themselves more maladjusted than the parents 
of nondisturbed children. This notion is gen- 
erally supported by clinical evidence (i.e., so- 
cial work and psychiatric interviews) and fol- 
lows from the relatively large amount of 
research (e.g., Baldwin, Kalhorn, & Breese, 
1945; Brown, 1942) demonstrating the ef- 
fects of parental attitudes and personality 
upon child behavior. However, the author 
knows of no studies which directly test this 
hypothesis by comparing parents of clinically 
disturbed children with parents of “normal”’ 
children in terms of some adjustive criteria. 

It is conceivable that intensive study of the 
parents of nonproblem children may reveal 
a degree of pathology in their backgrounds 
similar to that of parents of disturbed chil- 
dren. For example, Goodstein and Dahlstrom 
(1956) found no significant Minnesota Multi- 
phasic Personality Inventory (MMPI) differ- 
ences between parents of stuttering and non- 
stuttering children. The present research is in 
part an application of their basic design to a 
different experimental population. It also in- 
vestigates possible parental syndromes within 
the disturbed group which may differentially 
contribute to certain patterns of child pa- 
thology, such as acting-out vs. nonacting-out 
problems. 


Subjects and Method of Data Collection 


The booklet form of the MMPI was ad- 
ministered as part of the standard diagnostic 
procedure to all parents bringing a child for 

1The author is indebted to the child psychiatry 


staff at the University of North Carolina for their 
cooperation in collecting the data for this study 


evaluation to the Department of Psychiatry 
at the University of North Carolina Medical 
School from April, 1956 to June, 1957. In 
order to be included in the final analysis, both 
parents had to have taken the test and their 
child judged by the clinic staff as neither 
mentally defective nor organically impaired. 
Forty-nine sets of parents (all Caucasian) 
met the above criteria. 

The comparison group data were drawn 
from the population of control parents used 
in the Goodstein and Dahlstrom study 
(1956).2 These were parents of essentially 
physically normal, white children with no 
known behavioral disturbances. They con- 
volunteers from PTAs, church 
in and around the Iowa area. In 
all cases (as with the experimental group) 
both parents were living together at the time 
of the study. 

Each experimental parent was matched to 
a control parent on the basis of age, educa- 
tion, rural or urban residence, and, in the 
case of fathers, socioeconomic status. In or- 
der to achieve the closest possible matching, 
the control mothers and fathers were matched 
separately with the experimental mothers and 
fathers rather than by families. 

The mean age of the experimental fathers 
was 40.49 years (range, 30 to 58 yea: ‘. with 
average education of 11.59 years (range, 5 
to 20 years). That of the control fathers was 
40.79 years (range, 30 to 58 years), with av- 
erage education of 12.88 years (range, 8 to 


a 


20 years). The mean age of the experimental 


sisted of 


groups, etc. 


2A special debt of gratitude is owed Grant Dahl- 
strom who painstakingly provided the matched sam- 
ple of control parents’ MMPIs from the larger group 
used in his study 
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Table 1 
Means, SDs, and Significance of Difference Between 


Means of Experimental and Control Fathers 


Experimental Fathers 
N = 49) 


Control Fathers 
(N = 49) 


Scale* Mean SD Mean SD 
86 
48 
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mothers was 36.84 years (range, 26 to 55 
years), with average education of 12.37 years 
(range, 2 to 20 years). That of the control 
mothers was 37.31 years (range, 27 to 54 
years), with average education of 13.16 years 
(range, 8 to 21 years). 

Eighty-two per cent of the experimental 
families had urban residences, whereas 67% 
of the control group had urban residences 
Over 90% in both groups were Protestants, 
and they were largely lower middle-class 
families. 

The MMPIs were hand-scored for the four 
validity scales, nine clinical scales, and the 
Taylor anxiety scale (1953) 


Results 
Between Group Comparisons 


None of the profiles in either group were 
excluded on the basis of the validity scale 
scores. With the exception of two experimen- 
tal fathers who slightly exceeded a raw score 
of 7 on the L scale, the experimental group 
met the criteria used by Goodstein and Dahl- 
strom (1956) to exclude parents whose va- 
lidity scale scores indicated a significant de- 
gree of dissimulation. 


Since the 7 scores of the experimental 
fathers were significantly higher on the Hs, 
Mf, and Ma scales and significantly lower on 
the Pa and Anxiety (A) scales than the ex 
perimental mothers, the sexes were not com- 
bined in the subsequent comparisons with the 
control groups. The control fathers had sig 
nificantly higher 7 scores than the control 
mothers on the Mf and Ma scales. 

For the sake of reader convenience, the 
nine clinical scale scores (Hs to Ma) in 
Tables 1 and 2 are reported in terms of stand 
ard scores (7 scores) rounded off to the near- 
est whole number, although all computations 
are based on the more exact raw scores. As 
shown in Table 1, the experimental fathers 
had significantly higher mean scores on the 
Hs, D, Hy, and Pt scales than the control 
fathers. Table 2 shows that the experimental 
mothers scored significantly higher on the F, 
D, Hy, Pd, Pa, Pt, and A scales, whereas the 
control mothers significantly larger 
score on the K 

The various groups were compared as to 


had a 
scale 


severity of disturbance by counting the num- 
ber of individuals in each group who had one 
or more 7 scores on the nine clinical scales at 


able 2 


Means, SDs, and Significance of Difference Betweer 


Means of Exy i Control Mothers 


erimentai and 


Experimental Mothers 
\ 49 


ocale* 


Mear 


values are based on raw a 
nificant between the .05 ar 


hceant at greater t 
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70 or above (the usual cutting score for psy- 
chiatric disturbance). Twenty-six of the ex- 
perimental fathers had one or more 7 scores 
at or above 70 as compared to 15 of the con- 
trol fathers, and 22 of the experimental moth- 
ers had one or more scores in this range as 
compared to orly 9 of the control mothers. 
Chi square = 5.06 (p < .03) for the fathers, 
and chi square = 7.98 (p < .01) in the case 
of the mothers. 

It is also significant that there were 10 
mothers in the experimental group with 3 or 
more 7 scores above 70 and only 2 such 
mothers in the control group (chi square = 
6.10, p < .02). 

Since present-day MMPI interpretation 
places a great deal of emphasis on response 
patterns as well as elevation of scores, the 
various groups were compared in terms of 
relative frequency of occurrence of certain 
two-digit high point codes (i.e., the top two 
scores). Neither the fathers nor mothers in 
either group had a frequency in any given 
code pair exceeding five, and in all four 
groups there were almost as many different 
high point code pairs as there were people. 

A further analysis of the high point code 
was made by counting the frequency of oc- 
currence of each clinical scale in either first 
or second place within each group. In only 
one instance was a significant difference ob- 
tained between experimental and control fa- 
thers or between experimental and control 
mothers. Twelve of the experimental fathers 
had an Hs score in either first or second place 
as compared to only three of the control fa- 
thers. This difference is significant at greater 
than the .02 level of confidence (chi square 
6.16). 


Within Group Analysis 


In an attempt to gain some further under- 
standing of the nature of the relationship (if 
any) between parental pathology and child 
disturbance patterns, the experimental group 
was divided into four subgroups on the basis 
of symptomatology exhibited by the child as 
follows: 


1. The schizophrenic group (S) consisted of par- 
ents whose children (V = 9) were diagnosed as child- 
hood schizophrenics or severely schizoid (ie., ex- 
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hibited bizarre thought processes and/or markedly 
withdrawn and peculiar behavior). 

2. Parents of children (NV = 10) who had been re- 
ferred to the clinic because of delinquent or antiso- 
cial behavior were placed in the acting-out group 
(AO). 

3. The physical complaint group (PC) was com- 
posed of parents whose children (VN = 18) were suf- 
fering from various bodily symptoms for which no 
physiological basis could be determined 
from enuresis to headaches). 

4. The neurotic group (N) was constituted of par- 
ents of children (N= 12) who demonstrated behav- 
iors of a nonacting-out variety (such as difficulties 
in academic learning) but who were not considered 
as severely disturbed as the children in Group 1 


(ranging 


Since the parents of male children had no 
MMPI clinical scales significantly different 
from the parents of female progeny, sex dif- 
ferences among the children were not consid- 
ered in composing the above groups. There 
were 34 males and 15 females ranging in age 
from 4 to 17 years. Four of the girls were in 
the schizophrenic group, none in the acting- 
out group, eight in the physical complainers 
and three in the neurotic group. 

The four validity, nine clinical, and Taylor 
anxiety scores of each set of fathers in one 
group were compared with the fathers in each 
of the other three groups (i.e., S fathers were 
compared with AO fathers and with PC fa- 
thers, etc.). ¢ tests of the difference between 
means were also computed in the same man- 
ner for the mothers, making a grand total of 
12 sets of comparisons (14 in a set) or 168 
t tests. 

Only eight of these ¢ tests reached or sur- 
passed the .05 level of confidence, any or all 
of which may be significant on a chance basis 
However, five of the significant differences 
were found with respect to the Mf scale which 
may lend some validity to them. 

The S mothers were higher (more feminine) 
on the Mf scale than the AO mothers (¢ 
2.5, p < .05). Fathers of both schizophrenic 
and neurotic children had significantly higher 
Uf scores than fathers of acting-out and 
physical complaint children as follows: be- 
tween S and AO (t = 3.7, p < .05), between 
S and PC (t = 2.9, p. .05), between N and 
\O (t = 2.54, p= < .05), and between N 
and PC (t = 2.69, p < .05). The AO fathers 
had a higher mean Pd score than the S fa- 
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thers which just fails to reach significance at 
the .05 level. The N fathers were significantly 
lower on the D scale and significantly higher 
on the Ma scale than the PC fathers (¢ = 
4.22, p< .01 and ¢ = 2.37, p < .05, respec- 
tively). 

On the basis of the number of individuals 
with one or more 7 scores at or above 70, 
the S and N mothers combined were less 


severely disturbed than the AO and PC moth- 
ers (chi square = 4.13, p < .05). Similar dif- 
ferences were not found in the case of the fa- 
thers. A pattern analysis revealed no signifi- 
cant differences between any of the groups. 


Discussion 

Before interpreting these results the prob- 
lem of regional differences between the ex- 
perimental and control parents must be con- 
sidered. Although previous studies (Welsh & 
Dahlstrom, 1956) have found various MMPI 
scales to differ significantly as a function of 
certain demographic variables, region per se 
does not appear to have this effect. Goodstein 
(1954) failed to demonstrate regional differ- 
ences among large groups of male under 
graduates at eight different colleges scattered 
throughout the United States. 

In general, then, these results support the 
major hypothesis that parents of disturbed 
children are themselves more disturbed than 
the parents of nondisturbed children. Of 
course, this study does not enable us to de- 
termine whether the elevated MMPI scores 
of the experimental parents are related to the 
etiology of their children’s problems or are a 
result of them or both. 

While the mean scores of the experimental 
parents indicate that they tend to be more 
maladjusted than adults in general, they cer- 
tainly do not appear to be as abnormal as 
adults who seek psychiatric help for them- 
selves. As a matter of fact, the majority have 
scores more comparable to that of a normal 
group and as revealed by the pattern analysis 
they do not fit into the usual clinical cate- 
gories. This finding should be considered in 
deciding upon a course of therapy with par- 
ents who bring their children for psychiatric 
or psychological aid. 

Because of the large within-group variance 
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on any one MMPI scale, the attributing of 
psychologically incapacitating characteristics 
to the experimental parents on the basis of 
mean scores is at best indicative of certain 
group trends and does not necessarily apply 
to any individual within the group. Within 
the context of the above reservation, the ele 
vated scales of the fathers indicate that they 
tend to be weak, ineffectual males with an 
assortment of somatic concerns, whereas the 
experimental mothers are much more likely 
to act out their angry and disturbed feelings 
in relation to others as evidenced by their 
relatively high Pd and Pa scores. The major 
exception to this general characterization oc 
curs in the case of the fathers of acting-out 
children who tend to have significantly higher 
Pd scores than group of males 
It would also appear that the experimental 
mothers demonstrate more disturbed 
and as compared to normal 
mothers than do the experimental fathers ir 


any other 
verbal 
overt behavior 
comparison with the control fathers. In all 
cases, these findings are consonant with clini 
cal impressions. 

Essentially, the present study failed to es 
tablish any definitive relationships between 
parental pathology and the kinds of behavior 
problems exhibited by their children. Thi 
may be a function of the inapplicability of! 
the MMPI for such fine discriminations, the 
lack of within group homogeneity, the small 
size of the combination of 
these factors 

One 
1 common sense point of view is that the 
mothers of the schizophreni 
children (who are ordinarily considered the 


groups, or any 


somewhat contradictory finding from 


and neuroti 
more severely disturbed children) showed less 
disturbance on the MMPI than the mothers 
of acting-out and physically complaining chil- 
dren. An analysis of the socioeconomic back 
ground of the parents indicates a tendency 
for the parents of the schizophrenic and neu- 
children to have a higher 
socioeconomic status than the parents of the 


rotic somewhat 


other groups. As a consequence they may be 
MMPI 


items in a deviant direction, and more likely 


somewhat less prone to answer the 


to inhibit antisocial behavior. They may also 
be more enlightened concerning the functional 
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basis of some physical disorders and thus less 
likely to reward them. Cultural differences 
may also explain the higher Mf scores of the 
S and N fathers. 

It is obvious that this study raises more 
questions than it answers. The next step 
would be the initiation of a series of investi- 
gations to determine the parental behavioral 
patterns which are the basis for specific child- 
hood problems. 


Summary 


The MMPI was used to compare 49 sets of 
parents of clinically disturbed children (ex- 
perimental group) with 49 fathers and 49 
mothers of nondisturbed children (control 
group). The mean differences between the 
experimental and control groups on the 14 
MMPI scales analyzed and a frequency count 
of the number of individuals in each group 
who had one or more clinical scales at or 
above a T score of 70 (the usual psychiatric 
cutting score) strongly supported the general 
clinical impression that both fathers and 
mothers of disturbed children are themselves 
significantly more maladjusted than the fa- 
thers and mothers of nondisturbed children 
However, a pattern analysis and a visual com 


parison with the typical norms for psychi 
atrically disturbed adults indicated that the 
experimental parents are more like “normal’ 


Liverant 


parents than they are like adults who seek 
psychiatric help for themselves. 

An attempt to relate MMPI syndromes 
within the experimental group to various 
kinds of behavior problems exhibited by their 
children essentially met with failure. The dif- 
ferences that were found (primarily on the 
Mf scale) between parents of schizophrenic 
and neurotic children as compared to parents 
of acting-out and physical-complaining chil- 
dren seemed to be most parsimoniously ac- 
counted for on a cultural basis. 


Received May 14, 1958 


REFERENCES 


BaLpwin, A. L., Katnorn, Joan, & Breese, Fay H 
Patterns of parent behavior. Psychol 
1945, 58, No. 3 (Whole No. 268) 

Brown, F. An experimental study of parental atti 
tudes and their effects on child adjustment 
J. Orthopsychiat., 1942, 12, 224-231 

Goopstetn, L. D. Regional differences in MMPI re- 
sponses among male college students. J 
Psychol., 1954, 18, 437-441 

Goopstetn, L. D., & Danistrom, W. G. MMPI dii 
ferences between parents of stuttering and non 
stuttering children. J. consult. Psychol., 1956, 20, 
365-371 


Monogr., 


Amer 


consult 


Taytor, Janet A 
unxiety. J. 
00 

Wetsu, G. S., & Danistrom, W. G. Basic MMPI 
readings in psychology and medicine. Minneapolis 
Univer. Minnesota Press, 1956 


A personality scale of manifest 


Psychol., 1953, 48, 285 


abnorm. soc 





Journal of Consulting Psychology 
\ 3, No. 3, 1959 


RESPONSES TO THE WORDING OF PERSONALITY 
TEST ITEMS 


CHARLES HANLEY 


Michigan State University 


The discovery of “acquiescence” in person- 
ality tests, having led to considerable research 
in recent years, seems likely to continue its 
influence in the near future. Studies have 
tacitly assumed that the response set is a 
unitary source of test variance, perhaps be- 
cause Cronbach (1950), in his influential ar- 
ticle on the topic, attributed to acquiescence 
such diverse behaviors as checking misspelled 
words on a spelling test, checking “like” on 
interest inventories, checking “agree” on atti- 


tudes, and checking “no” on a temperament 


schedule. Little attention, however, seems to 
have been given to the possibility that there 
might be more than one kind of acquiescence. 

Acquiescence may be a personality trait. 
Leavitt, Hax, and Roche (1955), for example, 


related the set to “authoritarian submission,”’ 
and it is certain that the future will bring 
more studies of the personality correlates of 
acquiescence. On the other hand, Cronbach 
(1950) suggested that the set will usually not 
have predictive value, implying that acquies- 
cence is mainly a function of the test situa- 
tion itself. Consistent with this belief are as- 
sumptidns that acquiescence occurs most often 
when items are ambiguous (Cronbach, 1950), 
or “controversial” (Fricke, 1956). Accepting 
the hypothesis that the nature of the test 
items influences the response set, the pres- 
ent study explores the possibility that there 
are different “acquiescences,” and that these 
include responses to specific types of 
wording. 


item 


An early instance of acquiescence was given 
by Lorge (Lorge, 1937; see Cronbach, 1950 
for fuller discussion), who found a general 
tendency to like (or dislike) items on the 
Strong Interest Inventory; his long “gen-like’’ 
scale had high internal consistency. It is pos- 
sible that systematic differences in the man- 
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ner subjects defined the word “like” con 
tributed to the reliability of the dimension 
A subject who defined the word strictly (“It 
must mean really like”) would, other things 
being equal, have few likes on the test. One 
who adopted a loose definition (“Oh sure, I 
like that”) would check many likes. Even 
though both individuals had identical under 
lying attitudes toward the activities described 
in the items, the systematic difference in defi 
nition of the key word, “like,” would produce 
“gen-like” behavior 

“Like” is but one of many terms that might 
elicit systematic differences in interpretation 
“often,” “wish,” etc. are common in person 
ality tests. It also is possible that relative 
strictness in defining one key word is unre 
lated to the manner in which others are inter 
preted. If this occurs, acquiescences, rather 
than acquiescence, characterize personality in- 
ventories. The present study produces evi 
dence on this point 


Procedure 


Exploratory analysis of responses to the 
Minnesota Multiphasic Personality Inventory 
revealed that internally consistent scales could 
be defined solely from item stems (e.g., “I 
often,” “I have had’’). MMPI items, however, 
separate deviants from normals, and item con 
tent tends to describe personality difficulties 
The reliability of the provisional scales thus 
might be due to item content rather than indi- 
vidual differences in interpretation of wording. 
For this reason, six new scales were devised, 
each with 20 items. The investigator, lacking 
a pool of random meaningful items, attempted 
to vary content and avoid measuring unitary 
personality traits. The scales, mixed in a true 
false inventory, were given to 59 males and 
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63 female students in undergraduate psychol- 
ogy courses at Michigan State University. A 
score on a given scale consists of the number 
of items marked “true.” 

The Like scale consists of 20 items headed 
by the words “TI like” (e.g., I like work that 
calls for concentration and carefulness, I like 
picnics, etc.). Four other scales are headed “I 
wish,” “I never,” “I have had,” and “TI often. 
The sixth scale, Global, differs in that its 
items have no common stem. Item wording 
on the Global scale was designed to parallel 
the material in the California F Scale and 
similar attitude measures, in that self refer- 
ence is absent, and agreement with broad, or 
ambiguous, or somewhat grandiloquent atti- 
tudes is asked for. It was believed that scores 
would be determined in part by how critical 
an S§ was in dealing with items (i.e., critical 
Ss would disagree and less critical persons 
agree). Items ranged from the esoteric (The 
real rewards of true religious experience come 
not from earthly prosperity or hope of future 
salvation, but rather from sublime feelings 
which defy description with our limited vo 


1 Copies of the inventory be obtained fron 


the author 


ma 


Charles 


Hanley 


Table 1 


Internal Consistency of the Scales 


Kuder-Richardson Forn 
20 Reliability 


59 Males 


63 Fem: 


O01 
638 
59? 
RO 
337 


(NWO 


cabularies) to the more prosaic (It is easier 
to punish people than to judge them) 


Results 


Data are presented separately for the sexes 
Che internal consistencies of the six scales 


estimated by Kuder-Richardson Formula 20 
are shown in Table 1. Moderate reliability 


characterizes the measures, the exception be- 
ing Have Had in women. The scales are short 
ind have not been improved by item analy- 


sis, but the evidence for internal consistency 


clear. The reliability of the Like scale is 
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Table 3 


Unrotated First Centroid Factor Loadings 
and Communalities 


Factor 
Communality 


Factor 


Loading 


Men Womer Men Women 


I ofter 534 285 239 
I wis! 401 a 161 510 
Globa 633 101 
L like 313 QOS 
[ never 76 031 


I have ha 565 319 


quite comparable to Lorge’s results (see Cron- 
bach, 1950), provided allowance is made for 
the difference in number of items. Correla- 
tions between scales are given in Table 2. 

While systematic responses occurred, results 
may have been due to an influence common 
to all six measures. The internal consistency 
of the Often scale, for example, could have 
arisen because of general acquiescence (or 
some combination of influences). There are 
at least two ways to examine this possibility 
One of these, factor analysis, is more orthodox 
but leads to difficulties. First factor loadings 
of a centroid (using 
largest correlation as its diagonal 
entry) are shown in Table 3, together with 
the communality of the scale attributable to 
the first factor. The Have Had scale in women 
was not included because of 
consistency. 


factor analysis each 


scale’s 


its low internal 


When factor communalities are compared 
with the corresponding entries in Table 1, it 
is seen that reliabilities usually are much 
larger.2 When reliabilities and communalities 
are approximately equal, as in the case of the 
Global scale in men, it might seem reasonable 
to hypothesize a general acquiescence factor 


? The internal consistenc\ 
bound for a scale’s 
measures. To the 
reliably refle 
items, the 
with other 


efficient sets a lower 


orrelation with other 
single items in a scale 
t sources of variance absent in the other 
veasure will have 


potential 
extent that 


a greater communality 
tests of similar item heterogeneity. In the 
K-R 20 reliability as a 


“floor,” 


present study, the use of 
“roof,” rather than a 


tions means that the ar 


on expected correla 
nalysis is i 


onservative (i.e., 
is biased against the hypothesi f variance specifi 


to item wording 
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The contrary is true in women, however, 
where the Global scale’s first factor commu- 
nality is much smaller than its reliability. If 
the reliabilities and communalities are aver- 
aged for the two sexes, it will be seen that 
the first factor accounts for less than half of 
the reliable variance of the scales. 

There is reason to doubt whether even this 
contribution to scale variance can be at- 
tributed to general acquiescence. The first 
centroid factor can be the average of two or 
more independent common factors. Further 
extraction of factors and rotation of axes 
would be necessary to settle the question 
Subjecting the present data to multiple fac- 
tor analysis, on the other hand, encounters the 
objection that there are very few tests. Fur- 
thermore, if rotation to any criterion were at- 
tempted, the general factor loadings would 
decrease—less evidence of general acquies 
cence must result. Factor analysis is unsatis- 
factory for these reasons, but a second simpk 
approach is possible 

The hypothesis being considered may bi 
stated: “The internal consistency of each 
scale is due to general acquiescence.” Since it 
is assumed that the method of item selection 
has randomized content factors among the 
an important deduction follows from 
this proposition. The scales will correlate with 
one another, 


™ ales 
and the magnitude of their in 
tercorrelations will be a function of their reli 
abilities. When reliabilities can be estimated 
as in the present study, it is possible to con 
struct a matrix of correlations expected on 
the hypothesis that general acquiescence is 
responsible for internal consistency. Each hy 
pothetical coefficient is given by the formula 
for the correction for attenuation entered with 
a “true” value of 1.00 and the relevant reli 
abilities, and solving for the “empirical” co 
efficient. Each hypothetical correlation thus 
is given by the product of the square roots of 
the reliabilities involved 

These hypothetical coefficients are shown in 
Table 2 in parentheses below the correspond- 
ing actual values. In most empirical 
correlations are markedly smaller than theo- 
retical coefficients. In view of its internal con 


cases 


sistency, the Wish scale in men, for example 
48, .48. .47. 


scales, if the 


should have correlations of .57 


ind .46 with the other icquies 
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cence hypothesis is correct. The actual cor- 
relations of .21, .30, .03, .06, and .15, respec- 
tively, are much lower. It follows that the in- 
ternal consistency of this scale is too large to 
have been produced entirely by acquiescence 
shared with other measures. The alternate hy- 
pothesis, the existence of a response set spe- 
cific to items headed “I wish,” is thereby sup- 
ported. Similar reasoning applies to the other 
scales, with the exception of the Have Had 
measure in women. This scale has virtually 
zero internal consistency. The fact that it cor- 
relates with the other measures must be at- 
tributed to the operation of small independent 
factors shared with other scales. While corre- 
lations between tests have been treated as oc- 
curring from general acquiescence, this last 
finding suggests the presence of influences not 
contributing to internal consistency but op- 
erating to produce correlation between meas- 
ures that on first sight might seem the result 
of general acquiescence. 

ACE scores were available for 36 males and 
49 females. One correlation with the scales 
proved statistically significant (.05 level) 
—.34 between ACE and the Global scale in 
males (the corresponding value for females 
was —.16). This result lends some support 
to the assumption that responses to Global 
items are partly a function of the criticalness 
with which Ss respond, if criticalness is as- 
sumed to involve some intellectual ability. 

When the six measures were pooled in a 
“general acquiescence” measure, the K-R 20 
reliabilities were .73 for males and .70 for fe- 
males. On over-all reliability alone, therefore, 
one could hypothesize a general acquiescence 
factor, whereas finer-grain analysis would 
show independent sources of reliable variance 


Discussion 


If the findings of this exploratory study are 
either accepted or substantiated by further 
work with other stems and content, a num- 
ber of important consequences follow. Studies 
seeking to correct personality scales for acqui- 
escence should attend carefully to their ac- 
quiescence measures. The same caution is 
necessary when investigators set out to find 
the characteristics of the “acquiescent per- 
sonality.” It is entirely possible that many 
acquiescences exist. Some of these could re- 
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flect group factors. There might be, for ex- 
ample, relatively high correlations between 
scales defined by “often,” “usually,” “at 
times,” and “most of the time.” If such a 
“temporal” set exists, it could have interest- 
ing personality correlates. To search for a 
single set of correlates of acquiescence, how- 
ever, would be to disregard the complexity of 
test-taking behavior, and to lead to an over- 
simplified view of human nature. 

When a scale contains a variety of item 
stems, each eliciting individual differences in 
interpretation, the result is to lower the in- 
ternal consistency of the measure. Thus, when 
different item wordings are mixed in a single 
scale, a certain amount of “noise,” as opposed 
to “information,” is to be expected. To make 
items homogeneous in style, on the other 
hand, is to inflate the internal consistency of 
the scale. Such cases occur and are not lim- 
ited to true-false tests. Edwards (1954), for 
example, has worded the bulk of the items 
on his forced-choice Personality Preference 
Schedule in terms of “liking” something. The 
exceptions are all items on the Abasement 
und the majority on the Aggression scales. 
When both items in a forced-choice pair in- 
volve “liking,” the set is nullified, but when 
an abasement item is always paired with a 
“liking” item, the set could operate. It seems 
reasonable to expect that new forced-choice 
personality tests will appear in the future; 
consequently, it is to be hoped that strict at- 
tention is paid to item wording before inter- 
pretation of item content is attempted. 


Summary 

Six 20-item true-false scales were con- 
structed to test the hypothesis that responses 
on personality tests are in part a function of 
the subject’s interpretation of the wording of 
items. Five of the scales were homogeneous 
for item stems: “I often,” “I wish,” “I have 
” and “T like.” The sixth scale 
contained varied content worded in the man- 
ner of California F test items. 

The measures showed moderate reliability 
when given to groups of male and female 
university students. Intercorrelations among 


had,” “I never, 


scales generally fell below the values to be 


expected if the reliability of the individual 
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measures were due solely to general acquies- 
cence. There appear to be different types of 
acquiescent behavior, determined in part by 
the interpretation subjects make of key words 
in items. 


It was concluded that studies of “acquies- 
cence” in tests, and investigations of the “‘ac- 
quiescent personality,” require considerable 
attention to item wording before results can 
be accepted as definitive. 


Received May 20, 1958 
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THE STABILITY OF TAT FANTASY AND 
STIMULUS AMBIGUITY * 


JEROME KAGAN 


Fels Research Instits 


Although psychologists use fantasy re- 
sponses for both research and diagnostic pur- 
poses, information on the long-term stabil- 
ity and validity of fantasy variables is still 
needed. This report deals with the long-term 
stability of certain TAT content categories in 
relation to the ambiguity or “content pull” of 
the fantasy stimulus. Ambiguity is defined in 
terms of the number of alternative interpreta- 
tions given to a stimulus and as ambiguity 
decreases one expects several popular or 
modal interpretations to be elicited by the 
stimulus. When a fantasy stimulus is highly 
ambiguous, individual differences in thematic 
content may be due, in part, to differences in 
(a) the interpretation of ambiguous cues on 


the stimulus and (5) the subject’s cognitive 


approach to the task (Schwartz & Kates, 
1957; Weisskopf, 1950; Weisskopf-Joelson & 
Lynn, 1953). For example, the thematic con- 
tent produced to Cards 11 or 19 of the TAT 
series, which are highly ambiguous, seems de- 
pendent on both the subject’s hypothesis as 
to the nature of the “object” on the picture 
and his cognitive style in interpreting an am- 
biguous stimulus. Some people become de- 
scriptive of concrete details of the stimulus 
when asked to interpret an ambiguous pic- 
ture, while others, perhaps less anxious, proj- 
ect motives and feelings into their themes 
(Weisskopf-Joelson & Lynn, 1953). 
However, when the stimulus is structured 
to suggest a specific motive or conflict, one 
may assume that one of the subject’s hypothe- 
ses for interpretation included the motive 


1 This research was supported by a research grant 
(M-1260) from the National Institute of Mental 
Health of the National Institutes of Health, United 
States Public Health Service. The author wishes to 
thank Howard A. Moss for his comments on th 
manuscript. 
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illustrated. Thus, absence of a certain motive 
in a theme told to a stimulus suggests that 
content is apt to be a more valid measure of 
conflict than absence of this content to an 
ambiguous stimulus. For example, absence of 
an aggressive theme to a picture with no cues 
for aggression could indicate either (a) low 

ressive motivation, (6) strong aggression 
anxiety which led to inhibition of an ag- 
gressive theme, or (c) a descriptive and non 
thematic approach to ambiguous stimuli 
However, when a subject does not report an 
aggressive theme to a picture possessing ag- 
gressive cues, it seems most plausible to ac 
count for this behavior in terms of anxiety 
over aggressive motives. Thus, if conflict re- 
mains stable over time, occurrence or non- 
thematic content to stimuli 
which suggest conflictful motives is apt to be 
more reliable than the interpretations of am- 
biguous stimuli. Recent research suggests that 
fantasy interpretations of stimuli which sug- 
gest specific motives are also better predictors 
of related classes of overt behavior than fan- 
tasy responses to stimuli which are ambiguous 
for these motive areas (Crandall, 1955; Ep- 
stein & Smith, 1956; Kagan, 1956; Kagan & 
Moss, 1959; E. J. Murray, 1958; Scott 
1956; Weisskopf, 1950; Weisskopf-Joelson 
Asher, Albrecht, & Hoffman, 1957). 

The present research investigated the rela- 
tionship between the stability of TAT con- 
tent and stimulus ambiguity for a group of 
middle-class children who are part of the Fels 
longitudinal research population. 


occurrence of 


Method 
From the files of the Institute, 86 
Ss) were selected (44 boys and 42 girls) 
for whom three sets of seven card TAT proto- 
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cols were available. The median ages of ad- 
ministration were 8-9, 11-6, and 14-6. The 
seven cards administered from the H. A. Mur- 
ray (1943) series were 1, 5, 14, 17 BM, 3 
BM, 6 BM, and 3 GF. 


TAT Content 


The TAT protocols were scored for a va- 
riety of themes, but many of the themes were 
of infrequent occurrence and this report deals 
with the following content categories which 
have been classified as needs or press. 

a. Dependency n-Dep). The central figure ac- 
tively seeks aid, support, guidance, or encouragement 
from other figures 

b. Nurturance: 
given 


(p-Nurt). The central figure is 
advice, a gift, or encouragement from 
another figure and the nurturance was unsolicited by 
the central figure. 

c. Achievement: (n-Ach). The behavior or thoughts 
of the central figure are concerned with competition 
with a standard of excellence. This content was 
scored according to the definition of McClelland 

Atkinson, Clark, & Lowell, 1953) and is comparable 
to their score of Ach Th. 

d. Physical aggression by 
Ph Agg) 


physical aggression, e.g., 


love, 


the central figure: (n- 
The central figure executes or contemplates 
to fight, kill, injure 

e. Nonphysical aggression by the central figure: 
(n-Ind Agg). The central figure contemplates or exe 
cutes nonphysical aggression such as teasing, stealing, 
being angry, etc. This category includes nonphysical 
aggression at all figures except parents 

f. Nonphysical aggression to the parents by the 
central (n-Ind Agg Par). The central figure 
contemplates or executes nonphysical aggression to- 
ward the mother, father, or both parents 

g. Physical aggression directed at the central fig- 
(p-Ph Agg). The central figure is killed, in 
jured, or physically attacked by another person 


fieure 


ures 
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h. Nonphysical aggression directed at the central 
figure: (p-Ind Agg). The central figure is teased, re 
jected, or robbed by figures other than the parents 


Percentages of agreement between two in- 
dependent raters scoring the protocols was 
88%. The central figures were designated be- 
fore the scoring in the following manner. For 
Cards 1, 17 BM, 3 BM, 3 GF, and 14 the 
single figure on the card was the central fig- 
ure. For Card 5 the woman was the central 
figure unless the woman was designated as a 
mother and her child was a major figure in 
the plot. In these cases the child was the cen- 
tral figure. For Card 6 BM the young man 
was designated as the central figure. 


Results 
Age and Sex Differences in TAT Content 


Table 1 shows the percentage of boys and 
girls reporting one or more of the eight con- 
tent categories for each of the three protocols. 

There were only two marked age changes 
in frequency of the various contents. In com- 
paring frequency of occurrence for Protocol 3 
versus Protocol 1, achievement themes showed 
a significant increase with age for both sexes 
(p < .01), and the girls showed an increase 
in physical aggression by the central figure 
(p< .01). All p values are for two tails 
There were two significant sex differences in 
content. For both Protocols 1 and 2 the oc- 
currence of both dependent and nurturant 
themes were more frequent for girls than for 
boys (p< .02 for both contents). In 
trast with earlier findings on the content of 


con- 


Table 1 


Percentage Reporting TAT Ther 


Protocol 1 


Content Boys 


Giris 


Dep 15.9 42.9* 
p-Nurt 15.9 42.9" 
n-Ach 40.9 35.7 
n-Ph Agg 7.3 14.3 
n-Ind Agg 28.6 
n-Ind Agg Par 31.0 
p-Ph Agg 33.3 
p-Ind Agg 14.3 


02 for two tails 


es to Each of Three Protoco 


Protocol 2 


Gris 


38.1 


45 
40 
40 
38 
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doll play fantasy in preschool children, there 
were no marked sex differences in incidence 
of aggressive fantasy (Bach, 1945; Sears, 
1951; Yarrow, 1948). 


Stability of TAT Content 


Since the average occurrence of each of the 
content categories for any one protocol was 
one, phi coefficients were computed to assess 
the stability of the eight content categories 
over the three administrations. There were no 
marked sex differences with respect to the de- 
gree of stability of any of the content cate- 
gories and the sexes were pooled in comput- 
ing the final phi coefficients. Table 2 shows 
the values of phi and associated two-tailed 
significance values. 

It is apparent that, with two exceptions, the 
content dimensions were not very stable over 
time.? The two categories which showed a low 
but significant degree of stability were physi- 
cal aggression by the hero and need achieve- 
ment. Degree of stability was not simply re- 
lated to frequency of occurrence, for n-Ph Agg 
was not one of the more frequently occurring 
themes. Although p-Ind Agg showed a signifi- 
cant phi coefficient between Protocols 2 and 3 

2In order to determine if the stability of aggres- 
sive themes would change if the categories were 
pooled, phi coefficients were computed for the com 
bined category of all aggressive themes by the cen- 
tral figure (Categories d, e, f) and for all aggressive 
themes directed at the central figure (Categories g, 
h). The stability of these two combined categories 
was not statistically significant and did not differ 
from the stability of any of the individual aggression 
categories except for physical aggression by the cen 
tral figure 


Table 


Percentage of Entire Group Reporting TAT The 


Content 


n-Dep 
p-Nurt 
n-Ac h 
Ph 
Ind Agg 
Ind Agg Par 
p Ph Agg 
p-Ind Agg 


n \gg 
n 


n 
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Table 2 


of Occurrence of TAT Themes Over 
Administrations (Phi Coefficients) 


rhre« 


Average 


the other two phi coefficients were nonsignifi- 
cant and this category was not as stable as 
n-Ach or n-Ph Agg. An analysis of the dis- 
tribution of all eight contents to the seven 
TAT stimuli revealed that n-Ach and n-Ph 
Agg themes each occurred with a high de- 
gree of frequency to a specific picture which 
seemed suggestive of these contents. Physical 
aggression by the central figure tended to 
ur to Card 3 BM, which illustrates a 
slouched figure and an object often seen as a 
gun. Achievement themes occurred to Cards 
1 (boy with violin) and 17 BM (man on 
rope), both of which suggest competition 
and/or a desire to accomplish a task or im- 
prove at a skill. Occurrence of the remaining 
six contents, which were less stable, tended to 
be more evenly distributed over many of the 
TAT pictures. That is, there 


Oc¢ 


Was no one 


stimulus which was highly suggestive of any 


Ps 


One or More of the Three A« 





Stability of TAT Fantasy and Ambiguity 


Table 4 


Degree to Which the Occurrence of the TAT Themes 
Across TAT Stimuli Deviated From a Random 
Distribution (Values of Cochran’s Q 


Average 
Q 


n-Dep 20.2 12.0 
p-Nurt 6.2 13.3 
n-Ach 9? 4* 94.9 
n-Ph Agg 93.1* 69.9 
n-Ind Agg 10.0 15.0 
n-Ind Agg Par 19.2 17.0 


p-Ph Agg 36.3 2 31.0 


p-Ind Agg 16.8 


of these six contents. Table 3 shows the dis- 
tribution of each of the eight content cate- 
gories to the seven TAT stimuli. The num- 
bers refer to the percentage of the entire 
group reporting the specific content on at 
least one of the three administrations. 

Table 3 reveals that the only stimuli to 
which at least 40% of the group told the 
same theme were Cards 3 BM (n-Ph Agg), 
1 (n-Ach), and 17 BM (n-Ach). In order to 
test the statistical significance of the tend- 
ency for physical aggression and achievement 
themes to be nonrandomly distributed over 
the seven TAT cards, Cochran’s Q test was 
applied to the data for each of the three pro- 
tocols. This statistic tests the degree to which 
the pattern of occurrence of a fantasy theme 
to the seven TAT stimuli deviated from a 
random distribution, and the distribution of 
Q approximates that of chi square. The reader 
is referred to Cochran (1950) and Siegel 
(1956) for a summary of this technique. 
Table 4 shows the values of Q for each con- 
tent category to each of the three protocols. 
The larger the value of Q the less random 
was the distribution of the theme to the seven 
TAT cards 

The largest values of Q occurred for achieve- 
ment and physical aggression themes and Q 
was significant at the .001 level for these two 
contents for all three protocols. Furthermore 
the rank order correlation between the aver- 
age value of phi (measure of stability) and 
the average value of Q over the three ad 
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ministrations was +.81 (p < .05). This indi- 
cates that even for the contents which did not 
show significant values of phi, the degree of 
stability of a theme was facilitated by the 
presence of a stimulus which had some tend- 
ency to elicit the content in question. One im- 
plication of these findings is that when a 
fantasy motive or press occurs to a stimulus 
which does not suggest that content, the long- 
term stability of that fantasy variable tends 
to be very low. 


Discussion 


These data suggest that the long-term sta- 
bility of a fantasy motive or press is depend- 
ent on the ambiguity of the fantasy stimulus 
for that content. If one assumes that these 
content variables have some relation to com 
parable motive and response tendencies in 
other behavioral contexts, then one implica- 
tion of this finding is that a theme told to an 
ambiguous stimulus may be a less sensitive 
indicator of a motivational predisposition than 
a theme told to a stimulus 
Several investigations support this hypothesis 
Kagan (1956) found that boys who were 
rated as extremely nonaggressive were less apt 


nonambiguous 


to tell aggressive stories to pictures which 
suggested boys fighting than boys who were 
rated as extremely aggressive. The incidence 
of aggressive stories to ambiguous pictures 
did not differentiate these two groups. It was 
assumed that the low aggression boys were 
anxious over expression of aggression both in 
fantasy and overt behavior and inhibited this 
class of both situations. E. J 
Murray found that occurrence of 
sleep themes to pictures which were am 
biguous for this theme did not differentiate 
sleep deprived from nondeprived Ss. The 
stimulus which suggested sleep activity did 
differentiate the groups. The sleep de 
prived Ss were less likely to tell sleep themes 
to the nonambiguous stimulus, 


response in 
(1958) 


two 


and it was as 
sumed that sleep deprivation led to anxiety 
over the thought of sleep and produced an 
inhibition of sleep related fantasy. Epstein 
and Smith (1956) found similar results using 
hunger motivation as the experimental vari- 
ible. Incidence of hunger themes to pictures 


mbiguous for this content did not differenti 
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ate hungry from nonhungry Ss. However, to 
the stimulus which suggested a hunger theme, 
the hungry men were less apt than the non- 
hungry Ss to report this content. The authors 
suggested, as did Kagan (1956) and E. J. 
Murray (1958), that when a fantasy stimu- 
lus suggests a content which is associated 
with anxiety, the S tends to inhibit a theme 
which includes the anxious material. This rea- 
soning is based on the interaction of the 
gradients of approach and avoidance pos- 
tulated by Miller (1948). Aggression and 
achievement are both motives which are po- 
tential sources of anxiety (Kagan, 1956; 
Kagan & Moss, 1959; McClelland et al., 
1953; Weisskopf-Joelson et al., 1957), and 
thus the present results are consistent with 
previous theorizing and research. 

One implication of these studies is that a 
fantasy response to a stimulus which suggests 
a conflictful motive may be a more sensitive 
indicator of anxiety or conflict than the re- 
sponse to a stimulus which is ambiguous for 
that content. Lazarus (1953) has argued for 
the inclusion of nonambiguous stimuli in pro- 
jective instruments as a means of assessing 
conflict and type of defense to conflictful mo- 
tives. However, there has been a long stand- 
ing tendency to use projective tests which 
contained ambiguous stimuli because they 
were assumed to elicit the primary preoccu- 
pations of the S. With the recent emphasis on 
the importance of the defensive organization 
of the individual and the ways in which he 
can repress, deny, and distort anxiety arous- 
ing motives it seems profitable to use inter- 
pretations of nonambiguous stimuli as indices 
of conflict and associated defensive responses 
The present results indicate that interpreta- 
tions of nonambiguous stimuli are more stable 
over time and suggest that psychologists 
evaluating fantasy should take into account 
the specific stimulus to which the fantasy 
appears. 


Summary 


The long-term stability of eight fantasy 
categories on the TAT was assessed on a 
group of 86 children with TAT cards ad- 
ministered at ages 8—9, 11-6, 14—6. The eight 
contents were n-Dependence, p-Nurturance 


Jerome Kagan 


n-Achievement, n-Physical Aggression, n-In- 
direct Aggression, n-Indirect Aggression to 
Parents, p-Physical Aggression, and p-Indi- 
rect Aggression. Of the eight contents, only 
physical aggression by the hero and achieve- 
ment themes showed better than chance sta- 
bility over the three administrations. Analysis 
of the pictures to which these occurred re- 
vealed that these two contents occurred to 
pictures which were suggestive of these con- 
tents. The remaining content categories tended 
to occur with equal frequency to several of 
the cards and were not frequently elicited by 
any one stimulus. Thus, the stability of the 
content was related to the presence of a 
stimulus which had a tendency to elicit the 
theme in question. The sensitivity of non- 
ambiguous stimuli in assessing degree of con- 
flict and defensive reactions was discussed. 
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A STATISTICAL NOTE ON RACIAL DIFFERENCES 
IN THE PROGRESSIVE MATRICES 


ARTHUR R. JENSEN 


Institute of Psychiatry, University of London 


An article appearing in this Journal (Sper- 
razzo & Wilkins, 1958) presented an analysis 
of variance of scores on Raven’s Progressive 
Matrices. The main variables in the analysis 
were age, sex, race, and socioeconomic (S-E) 
status (as judged from father’s occupation). 
Variance estimates attributable to age, race, 
and S-E status were found to be significant 
beyond the .01 level. However, the fact that 
there was a significant first-order interaction 
between race and S-E status and a significant 
third-order interaction between race, sex, age, 
and S-E status led the authors to conclude 
the following: 


It is apparent from the significant race by soci 
economic status interaction and the third-order in 
teraction that a restriction on the interpretation of 
the race difference found is necessary. The measured 
differences in scores between races are related to the 
age, sex, and socioeconomic status of the Ss. The re 
sults cannot be interpreted, therefore, as showing dif 
ferences in intelligence between the races tested here 
The differences found seem to depend upon varia 
tions of the nonrace factors (Sperrazzo & Wilkins 
1958, p. 37) 


This is an incorrect interpretation of the 
analysis and, therefore, from a statistical 
standpoint, an unwarranted conclusion. The 
most stringent test of the significance of the 
main effects is obtained in this case, not by 
using the residual (or within group) variance 
as the error term, but by including ai/ the in- 
teractions (in addition to the within group 
variance) in the error term. This 
done in Table 1. 

It may be concluded that in spite of 
teractions between the variables (race, 
status, age, sex), the race difference is highly 
significant statistically. The 
centage of the total 


has been 


the in 
S-E 


approximate per 


variance in Matrices 
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scores in this study attributable to age is 
23%; to race, 10%; to S-E status, 5%; 
to sex, 0%. 

It should also be pointed out that while the 
Matrices are regarded as a test of general in- 
telligence, with a G saturation of about .80 
(Raven, 1947), the term “intelligence” in the 
above quotation would seem to call for in 
verted commas in view of the unusually low 
correlations found in this study between the 
Matrices and three other tests of intelligence. 


and 


lable 1 


is of Variance of Pr 


irce oi oums 


riation Squares 
20,759.96 
4,772.60 

80.03 
2.116.80 
1.056.52 528.26 


12,734.01 71 7.04 


80.03 


2.116.80 


Of course, the actual magnitude of the 
racial difference may be small, even 
though the difference is highly significant sta- 
tistically. An analysis of variance performed 
on the three socioeconomic groups separately 


very 


1 addition to presenting the mean scores for 
each race within each S-E group, would give 
more complete and meaningful picture 
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The additional analyses suggested by Jen- 
sen have been undertaken, and the results are 
shown in Table 1. Three analyses of variance 
are presented by socioeconomic status of 480 
children, this status being based only upon 
occupation of the father. The three levels of 
such status are represented as follows: S-E 
(A): professional or semiprofessional; S-E 
(B): skilled, semiskilled, or clerical; S-E 
(C): service, unskilled, or labor. The findings 
in Table 1 show a significant difference be- 


437.58 17.94* 
980.10 
5.60 


1). 20* 


24.38 
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University 


tween the white) in two 
of the three socioeconomic status interactions 
reported earlier. Mean score for each race at 
each of these three levels is shown in Table 2 

The authors that the 


races (Negro and 


recognize index of 


socioeconomic status used for both white and 
Negro groups does not equate the samples 


from the two races on socioeconomic level as 
this concept is defined in conventional treat 
ments of social classes. Rather. the index was 


intended to provide an ordering within each 


$15.20 
105.62 
198.02 
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race that would parallel the order obtained 
from more precise indices. The assertion that 
\merican Negro class structure is not directly 
comparable to that of American white has 
convincing support from social science litera- 
ture. Therefore, it is not surprising that “race 
differences test 
is sensitive to varia- 
background. What is 
more surprising is that a relatively nonverbal 


in “intelligence 
found with a test that 


socioeconomic 


scores are 
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performance test is demonstrably sensitive to 
differences in socioeconomic level. 

The usefulness of the S-E index even to 
rank-order Negro class structure is thrown 
into doubt by an examination of mean differ- 
ences by S-E index, race, and sex. For white 
males and females, there is a difference of 
over five points in mean test score between 
the top and bottom S-E categories (P < .01). 
Although there is a mean difference of 3.68 
between top and bottom S-E category for Ne- 
gro females (P < .01), there are no demon- 
strated differences among the categories for 
Negro males (P > .10). One may conjecture 
after the fact that, for example, service oc- 
cupations (S-E Level C) are functionally 
equivalent to or higher among Negroes than 
semiskilled or clerical occupations (S-E Level 


Gerald Sperrazzo and Walter L. Wilkins 


B). The differences between Negro males and 
females in the ordering of test scores for the 
three S-E groups might reflect a sex differ- 
ence in accuracy of reporting father’s occupa- 
tion or, more precisely, a sex difference in 
willingness to report a socially less acceptable 
family arrangement. 

The question raised by Jensen leads to 
speculation on several fronts, and we wish to 
thank him for stimulating this re-examination. 
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Defensiveness is a popular, but.difficult to 
measure, concept. Page and Markowitz (1955) 
have defined it as follows: “The defensive in- 
dividual is described as one who fails to 
ascribe to himself characteristics of a gener- 
ally valid but socially unacceptable nature.” 
As Hogan (1952) has pointed out in his the- 
ory of threat and defense, there are two gen- 
eral theories of pathology. The first theory 
holds that pathology is due to frustration, or 
blocked needs, and the second that pathology 
is due to threat. As Hogan defines it, “Threat 
occurs when the self perceives its experiences 
as being inconsistent with the structure of the 
self.” It is then necessary for the individual, 
in order to maintain his perceived self, to dis- 
tort experience, particularly that experience 
which is contrary to his self image. Conse- 
quently, we would expect defensive individu- 
als to be low in self insight. 

The K scale (Meehl & Hathaway, 1946), 
which is generally considered a measure of de- 
fensiveness (McKinley, Hathaway, & Meehl, 
1946: Page & Markowitz, 1955: Sarason, 
1956; Grayson & Olinger, 1957; Handley, 
1957) because it detects abnormals who de- 
scribed themselves as normal on the MMPI, 
was used as a defensiveness measure in the 
present investigation. 

The hypothesis tested was: The more de 
fensive the individual, the less insight he will 
have. Unexpected results necessitated a second 
study, designed to retest this hypothesis and, 
in addition, to test the hypothesis that the K 
scale is a measure of defensiveness 

Method 
Subjects and Task 

In the first investigation the subjects (Ss) 
were 45 male and 45 female summer school 

1 The author wishes to thank Jacqueline Good- 
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students at the University of Delaware, who 
participated in nine male and nine female 
five-person groups. The task was to solve, by 
means of a 25-minute discussion, an interest- 
ing but difficult industrial personnel problem 
(Maier, 1950). 

In the second investigation, the Ss were 11 
male and 3 female first-line supervisors (fore- 
men), and 12 male second-line supervisors in 
a large eastern corporation. The Ss were par- 
ticipating in a five-day management training 
course in which the interpersonal factors in 
management through the 
of role-playing, feedback sessions, etc. Two 
training groups were used, separated in time, 


were stressed use 


one group for first-level and one for second- 
level supervisors. 


Measures 


In the first investigation, the K scale was 
to 


measured by having each S indicate for three 


used ieasure defensiveness. Insight was 
negative roles (aggressing, blocking, withdraw 
ing) who (including himself) took the roles 
An insight score was computed for each S 
by determining the discrepancy (ignoring the 
sign) between the number of roles he credited 
to himself, and the average number of roles 
credited to him by the group 

In the the K 


was again administered, as was the role list, 


second investigation, scale 


expanded to include four negative roles. In 
addition, each S rated each group member on 


defensive behavior. Defensiveness was defined 
on the rating form as follows: 


By defensiveness, we m«¢ 
son to become 
the tendency 
take when it 
take, the avoidance of 
critical, etc 


in the tendency of a per 
upset if anyone finds fault with them, 
to deny having made an error or mis- 
is obvious that we have made a mis- 
evaluations which might be 
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Table 1 


Number of Ss Accurate or Inaccurate on 
Negative Roles by K Scores 


Inaccu 
rate 


Accu- 


rate Totals 


Above mean on K scale 2: 44 
Below mean on K scale ] 46 
Total 2! 90 


x? = 5.85* 


Results * 
The First Investigation 


The K scale scores were broken at the 
mean, and the insight scores were dichoto- 
mized into completely accurate or not com- 
pletely accurate categories. We see from 
Table 1 that there is a significant relation- 
ship between defensiveness, as measured by 
the K scale, and insight, with the more de- 
fensive individuals having the most insight. 
This result is contrary to the hypothesis. 


The Second Investigation 


The rank order correlation between the K 
scale and insight on negative role behavior is 
—.52**, which cross-validates the relation- 
ship found between the K scale and insight 
in the first investigation. The rank order cor- 
relation between the defensiveness rating and 
insight on negative role behavior is +.60**, 
which supports the original hypothesis. 

The reliability of the defensiveness rating 
scores, computed for each S by averaging the 
ratings of the other group members, was com- 
puted by correlating the mean ratings of the 
odd numbered and even numbered raters. The 
resulting corrected reliability correlation is 
.91. The corrected reliability coefficient on 
the average negative role scores used for com- 
puting the insight scores was .87. Finally, we 
find that the correlation between the K scale 
and the defensiveness ratings is —.39*. 


Discussion and Conclusions 


At this point, our results are both persist- 
ent and contradictory. Our two measures of 

2 Statistical significance at the .05 level has been 
indicated by a single asterisk; at the .01 level by a 
double asterisk 


defensiveness are negatively correlated. The 
K scale was carefully constructed empiri- 
cally, and cross-validated. The defensiveness 
behavioral ratings were made by combining 
the judgments of 11 or more Ss, each of whom 
had had 40 hours of observation on which to 
base their ratings. 

It is possible to rationalize the data, how- 
ever, if it is recalled that the K scale items 
are essentially a list of negative behaviors 
which the S is asked to either accept or deny 
as applying to himself. Consequently, when 
the original K scale standardization Ss, who 
were abnormal on such criteria as institu- 
tionalization, obtained high scores on the K 
scale (i.e., denied abnormal behavior) it was 
clear that they were being defensive. How- 
ever, in the two investigations reported here, 
we were dealing with normal Ss and found 
that normal Ss who denied, on the K scale, 
considerable abnormal behavior had good in- 
sight and were not seen as behaving defen- 
sively. On the other hand, our normal popu- 
lation Ss, who admitted a large number of 
negative traits on the K scale, had poor in- 
sight and behaved defensively, suggesting 
some degree of insecurity or neuroticism on 
their part. In sum, it is argued here that it 
is defensive for abnormal population Ss to ob- 
tain high K scale scores but a sign of health 
for normal populations Ss. This explanation 
can be supported by several other investiga- 
tions. Wheeler, Little, and Lehner (1951) in 
their factor analysis of the MMPI present 
evidence for an interpretation of the K scale 
as a measure of ego defenses. Sarason (1956), 
using the K scale as a measure of defensive- 
found that those scoring high in defen- 
siveness were significantly superior on the 
ACE and tended to be superior in grade- 
point average. These results were interpreted 
as due to the adverse effect on performance of 
the self-criticism of low Ks. Sweetland and 
Quay (1953) summarize several bits of in- 
formation which indicate that normal K 
scores may indicate social security and emo- 
tional adjustment. They conclude: “The sug- 
gestion was made that K scores, when within 
normal ranges, may possibly be a measure of 
personality integration.” In view of the evi- 
dence, as seen in Wheeler, Little, and Lehner’s 
data, that the mean K scores of normal popu- 


ness, 
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lation groups are higher than those of abnor- 
mal populations, Sweetland and Quay might 
better have concluded that high K scores on 
normal populations are a measure of person- 
ality integration. 

In conclusion, it is believed that the data 
supports the hypothesis that defensive indi- 
viduals are low in insight. Secondly, the data 
indicates that the K scale should not be used 
as a measure of defensiveness with normal 
populations. In addition, these results sug- 
gest that greater caution should be exercised 
in the intepretation of clinically derived meas- 
ures used with normal populations.* 


Summary 


Two investigations were made of the rela- 
tionship between defensiveness and insight. 
The hypothesis tested was that defensive in- 
dividuals would be low in insight. In the first 
(laboratory investigation), using the K scale 
of the MMPI as a measure of defensiveness, 
a significant relationship was found but was 
not in the predicted direction. 

In a second (field investigation), the origi 
nal hypothesis was supported by a high posi- 
tive relationship between defensive behavior 
ratings and insight. The K scale again corre- 
lated in the wrong direction with insight and 
was negatively related to the defensive be 
havior rating. 


It was concluded that: 1. Individuals who 


8 This is reminiscent of our early experience with 
the Rorschach, when we were astounded at the num- 
ber of our friends and colleagues 
criteria, were schizophrenic 


who, by clinical 


behave defensively in groups are low in in- 
sight. 2. The K scale is not an adequate 
measure of defensiveness on normal popula- 
tions. 3. Greater caution should be exercised 
in the use of clinically derived measures on 
normal populations. 
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MANIFEST ANXIETY, INTELLIGENCE, AND 
COLLEGE GRADES‘ 
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Duke Univer 


KATZENMEYER 


Several studies recently reported in this jour- 
nal have examined the relationship between the 
Taylor Manifest Anxiety Scale (MAS) and col- 
lege grade-point averages (GPAs). Matarazzo 
et al. and Klugh and Bendix found nonsignificant 
MAS-GPA correlations of —.08 and .01, respec- 
tively; Sarason reported that analysis of variance 
failed to reveal any changes in GPA as a func- 
tion of MAS score. Although ACE scores were 
available to all of these Es, only Klugh and 
Bendig took intelligence into account in evaluat- 
ing the relationship between MAS scores and 
grades, and none considered the possibility that 
anxiety might be differentially related to grades 
for students with differing intellectual abilities 

The moderately high correlations which have 
been consistently reported between various meas- 
ures of intelligence and college grades would seem 
to indicate that poor academic performance was 
primarily determined by limited ability while 
good grades were largely determined by superior 
intellectual endowment. Thus, personality or mo- 
tivational variables might be most likely to in- 
fluence the academic performance of students 
with average ability. The purpose of the present 
study was to examine additional evidence on the 
relationship between MAS scores and GPAs and 
to determine whether this relationship varied as 
a function of the intellectual level of the student 

The MAS was administered to all students 
the introductory psychology course at Duke Uni 


1An extended report of this study may be ob 
tained without charge from Charles D 
Department of Psychology, Duke University, Dur 
ham, North Carolina, or for a fee from the Ameri 
can Documentation Institute. Order Document No 
5889, remitting $1.25 for 5 


photocor vies 


Spielberger 


microfilm or $1.25 f 


srsity for six consecutive semesters, and GPAs 


weve obtained for that particular semester dur- 
ing which a student had taken the MAS 


MAS 
ACE scores, and GPAs were available for 

n. The intertest Pearson r’s were MAS- 

14; MAS-ACE, —.11; ACE-GPA, .29 
gnificant at .01 level). Even when intelli- 

ice was not taken into account 
iall inverse relationship between MAS scores 
grades in the present study. In order to de 
ne whether this relationship was influenced 
the intellectual ability of the Ss, the total 

e was divided into the following groups o1 

isis of ACE scores: lower 20%; middle 

nd upper 20%. The MAS-GPA correla- 

for these groups were —.04 18, and 
respectively. Tests for linear and curvi- 
near regression indicated GPAs were unrelated 


there was a 


to MAS scores for the low and high intelligence 


ips; the test for linear regression for the 
liddle group yielded an F of 13.06 (df = 1,39 
Grades varied inversely with anxiety 

average aptitude Ss 


peared to be too difficult for low aptitude stu- 


for the College work 


whose poor grades were unrelated to their 
High aptitude 


good grades regardless of 


students tended to 


scores 
their anxiety 
ous studies may have failed to find a sig- 
MAS 
les for one or more of the following reasons 

iilure to take intelligence into account; (6 
c) in- 
of both male and female Ss d) other 
discussed in the extended report in which 
tudies are compared 


relationship between scores and 


rogeneity with respect to intelligence 
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PROGNOSTIC FACTORS IN SCHIZOPHRENIA ' 


BETH STONE 


State University of J 


in attempt to identify some of the prog 

ic factors in schizophrenia, Schofield, Hatha 
way, Hastings, and Bell (1954) obtained follow- 
up data on schizophrenic patients and compared 
good and poor outcome groups in terms of 201 
items pertaining to their general history, previ 
ous personality, and presenting illness. Using the 


items which discriminated best, they devised an 
scale which 


subjects (Ss) 


rrognostic when applied 
identified 59% whos« 
adjustment had been good and 82% 
tment had been poor. Since this did 

adequate validation, an attempt 
the present study to cross-validate 
heir s 
The Ss were patients 


state Psychopathic 


admitted to the Iowa 
Hospital with a diagnosis of 
schizophrenia during the They 


1 larger group studied by Malamud 


years 1929-1933 
vere part olf 
and Render (1939) who made personal follow-u 
contacts in 1938. The case histories as well 
Malamud’s follow-up reports on these patients 
are still available. Even though Ss of the present 
tudy were hospitalized some 5 to 15 
lier than Schofield’s Ss, the 


groups was quite 


years ear 
of both 
neither group having 
insulin, or metrazol ther- 
apy. Both groups were followed up at least five 
years after their hospital admission 

On the basis of the 


Schofield et al. used 


treatment 
similar 
received electroshock 


Same five-step scaie which 


(1954 p 157 each S was 


assigned a rating in regard to his posthospital ad 
vf this study may be ob 
I Beth Stone, Dept ol 
Psychiatry, State Univer. of Iowa, Iowa City, Ia. o 
for a fee from the American Documentation Insti 
tute. To obtain it from the latter source, order Docu 
ment N 5890, microfilm or 
$1.25 f 

2 Now 


ity, St 


tained without charge fron 


remitting $1.25 tor 
photo opies 

a graduate student at Washington Univer 
Louis 


ment. Following the procedure of the Min 
Ss who fell into the four ex 


treme outcome categories were used as criterion 


nesota investigators 


groups. Our Good outcome group consisted of 19 
Ss, and our Poor group of 64 Ss. Without the 
rater having knowledge of the outcome ratings 
each patient was rated on the eight-point prog- 
(Schofield et 163). In- 
tra- and interrater reliability checks yielded 91% 


nostic scale 


al., 1954, p 
igreement and 86% agreement respectively 


Since most of the case hist 


ories contained nx 
nformation regarding the patient’s school deport 
ent, it was necessary to omit Item 1 of the 
the data 


~w of this alteration « t] le, the 


tic scale in the 
pres 
study is not a complete cross-validation. Ap 


tion of this seven-point scale to the patients 


Good and Poor grou using a cutting 
of three or more points to identify cases 
poor prognosis, resulted in identification of 
of the cases in the Good group and 
clearly no better than 
should be noted that 

© of the total sample was in the Good group 
and 68% in the Poor group item analysis re 
vealed that none f tl iten in the s¢ 
criminated between the tw utcome groups 


the .05 level of gI 
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SOCIAL DESIRABILITY IN THE SENTENCE 
COMPLETION TEST ' 
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This study attempted to show that: (a) the 
Social Desirability (hereafter called SD) of sen- 
tence stems is directly related to the SD of the 
responses to those stems, and (b) the tendency 
to give socially desirable responses on an inven- 
tory type test was related to a similar response 
tendency on a sentence completion test. 

Fifteen sentence stems were selected so that 
their SD scale values were relatively evenly dis- 
tributed throughout the rating range. The re- 
sponses to these stems of 50 psychiatric patients 
at Seattle VAH were then rated for SD by 50 
judges. The mean reliability coefficient for these 
ratings adjusted by the Spearman-Brown Proph- 
ecy formula was .84. 

SD scores were computed for each sentence 
stem and for each patient. These scores were 
compared with the SD scale values of the sen- 
tence stems and with the patient’s scores on the 
SD scale of the MMPI. The SD scale values of 
the sentence stems correlated .79 (p= .01) with 
the mean SD ratings of the responses to the 
stems. The patients’ sentence completion SD 
scores correlated .35 (p= .05) with their SD 
scale scores. Five groups of 10 patients each 
were selected on the basis of the height of the 
patients’ SD scale scores. These groups were then 
compared with respect to their sentence comple- 
tion SD scores by an analysis of variance design 

1An extended report of this study may be ob- 
tained without charge from Vitali V. Rozynko, VAH 
American Lake, Wash., or for a fee from the Ameri 
can Documentation Institute. Order Document No 
5891, remitting $1.25 for microfilm or $1.25 
photocopies 


rhe differences between these groups were highly 
significant (F = 4.14, p = .01). This high F ratio 
was primarily due to the mean differences be- 
tween the high SD scale scorers and the four 
lower scoring groups. The mean difference be- 
tween the two highest scoring groups yielded the 
smallest ¢t, that of 2.93 (p= .01). There were no 
significant differences between any of the four 
lower scoring groups. 

It was concluded that: (a) the SD of the sen- 
tence stem performs the function of establishing 
the direction of the response. A socially desirable 
stem tends to evoke a socially desirable response 
and vice versa; (b) that only patients scoring 
extremely high on the SD scale tend to perpetu- 
ate this response set on the sentence completion 
test. Meltzoff (1951) reports similar results as to 
the effect of the sentence stem on responses of 
college undergraduates. He also found that stu- 
dents placed in stress situations gave a greater 
number of positively toned responses on a sen- 
tence completion test than those who took the 
test under nonstress conditions. These results sug- 
gest that the psychiatric patients in this study 
who scored high on the SD scale perceived the 
testing situation as threatening and attempted to 
hide their “weaknesses” from the hospital staff. 
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AGREEMENT AMONG RATERS ON THE MULTI- 
DIMENSIONAL SCALE FOR RATING 
PSYCHIATRIC PATIENTS ' 
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The MSRPP (Lorr, 1953) has provided the 
principal criteria of behavior change in a series 
of VA cooperative studies of psychopharmaco- 
logic treatment of acute and chronic schizo- 
phrenic patients. Data were collected as part of 
one of these studies to provide information on 
the rater consistency of the scale, and additional 
data relative to the stability over time of ratings 
of patients-in a placebo group were available 
from another. The results can serve as a supple- 
ment to findings recently reported by Stilson 
Mason, Gynther, and Gertz (1958). 

A total morbidity score and 11 factor scores 
are derived from 49 individual scales. Most of 
these scales are rated from impressions gained 
during an evaluative interview, and the remainder 
from ward observations. In the VA studies, each 
patient was interviewed by a clinical team who 
later recorded consensus judgments for this part 
of the scale. A ward team of nurses and psychi- 
itric aides completed the ward items in a similar 
manner. In one study, the members of each rat- 
ing team rated patients independently prior to 
pooling impressions. Of the 563, newly admitted 
acute and chronic patients on whom independent 
ratings were made at a pretreatment evaluation 
period, 414 were rated by two clinical and two 
ward team members, and 149 by three clinical 
and three ward team members. Because the in- 


1 An extended report of this study may be ob- 
tained without charge from the VA Central NP Re- 
search Unit, VA Hospital, Perry Point, Md., or for 
a fee from the American Documentation Institute. 
Order Document No. 5892, remitting $1.25 for mi 


crofilm or $1.25 for photocopies 


and ward ratings must be combined to 
obtain morbidity and factor scores, ward and in- 
terview ratings were paired at random (within 
each set) to form a scorable set of ratings. Intra 
class correlation was used to determine the agree 
ment among raters. For total morbidity this co 
efficient was .82; for the factors, as follows: A 
Retarded depression vs 72 


terview 


excitement 
65: C. Paranoid 


manic 
B. Compliance vs. resistiveness 
75; D. Activity level, .71; E. Melan- 
choly agitation, .63; F. Perceptual distortion, .80 
G. Motor disturbances, .71; H. Submissiveness 
vs. belligerence, .73; I. Withdrawal, .71; J. Self- 
depreciation vs. grandiose expansiveness, .72; K 
Conceptual disorganization, .80 

Additional ratings were available for 179 mostly 


projection 


chronic schizophrenic males before and after six 


weeks of inclusion in a lactose placebo group. The 


product-moment correlation coefficient for total 


morbidity was .74. Stilson et al. (1958) reported 
1 similar coefficient of .80 with chroni 


three we eks 


schizo 
phrenic females wher 
tween ratings 


intervened be 
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VALIDITIES OF WAIS SHORT FORMS IN A 
PSYCHIATRIC POPULATION ' 


WILLIAM HOWARD 


Central Louisiana 


Using the method advocated by McNemar 
(1950), Maxwell (1957) has presented the 10 
highest short form, full-scale correlations for 
combinations of two, three, four, and five WAIS 
subtests. The purpose of the present research 
was to determine similar coefficients from the 
scores of psychiatric patients. 

Ss were 186 hospitalized patients who had been 
administered the WAIS previously by a variety 
of examiners. Of this total, 70 were schizophret 
ics, 27 were psychoneurotics, 27 had personality 
disorders, 22 were manic-depressives, and the re 
mainder were scattered among a variety of diag 
nostic groups. By education, the Ss ranged fron 
none to a college degree, and the median was 
around nine school years. 

Short form, full-scale 
puted for the same combinations, five each of 
duads, triads, tetrads, and pentads that Maxwell 
found to yield the highest coefficients. Analysi 
was made separately for three age groups 

Age group 25 to 34 produced coefficients 
ranged from .929 
highest pentad. For age group 35 to 44 the c 
efficients ranged from .886 to .971. In age grou; 
45 to 54 the range was .913 to .985. 

The results for age group 25 to 34 are higher 
than those found by Maxwell. This discrepancy 


appeared to be due to the greater variance of the 


correlations were con 


the lowest duad, to .985 


1An extended report of this study may be ot 
tained without charge from William Howard, P. O 


Box 31, Pineville, Louisiana, or for a fee from the 
American Documentation Institute. Order Document 
No. 5893, remitting $1.25 for microfilm or $1.25 f 
photocopies 


State Hospital 


psychiatric full-scale scores, which was signifi- 
cant at the .02 level. 

The present author 

same 20 combinations) 
Wechsler’s (1955 

of McNemar’s (1950) formula 

The coefficients ranged from .909 to .977, find- 


ngs which are comparable to those observed in 


short form 
correlations 


( omputed 
full-scale 


to 54 age 


general 


group by 


nt difference in full-scale variance between 
two groups at this age 
In addition to reliable short 
rrelations, pairs of subtests were found to cor 
highly with the verbal and performance 
None of the coefficients studied fell below 


form full-scale 
reiate 
scales 
general, the short form, full-scale correl 
were higher for the psychiatric patients than 
the standardization sample, but the differences 
ppeared to result from the greater variance of 
he patient sample. Since the correlations in the 
concluded 
could be 


groups were comparable, it was 
uny of the short 
ed to estimate reliably the intelligence of ps‘ 


itric patients 


forms studied 
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TEST 


New Tests 


Joseph R. Subsumed Abilities 
adults. 1 form. 30 min. Test Booklet 
pp. 25, and scoring key and 
Rochelle, N. Y.: Bruce, 1957 
The Subsumed Abilities Test (S.A.T.) is a pencil 

and-paper derivative of the Goldstein-Sheerer Color- 

Form Test and is 


Sanders, Test. Age 6 
, with manual, 


tabulation sheet. New 


Sorting available only for research 
use. Like its parent, it requires each subject to make 
more than one appropriate 
stimulus. All 30 
comprised, 
four pairs 
in each 
are alike 


-cognize, to 


response to the same 
items, of which the test is 
present either four geometrical figures or 
The task is to pick out two sets of three 
item (the two sets may be identical) that 
some Each of the three abilities 
abstract, and to conceptualize—is 
third of the items. On 
f the two item engages the ability 
at a simple level, the other at a more complex level 
The scoring key and tabulation arranged 
to obtain a score for each ability and a total 
The manual offers a rationale for the test that sug 
rarchy of six simple recognition, 
simple abstraction, complex ab- 
simple conceptualization, complex concep- 
Little data are currently available and 
cited. The manual presents of per 
equivalents for samples drawn from grade 
school, college, professional, secretarial, and “white 
applicants. Some of small in 
number as 42 
As the stamp on the Test 


h use only.”—E. S. B 


visual 


way 
purportedly tapped by one 


responses to an 


] 
sheet are 
score 
gests a hie ibilities 
complex 
straction, 
tualization 


recognition, 


less art tables 


centile 


collar” these are as 


Manual savs, “for re 


Jastak, Joseph F. Jastak Test. Junior High School 

form. Approximately 60 min. (one subtest is ad- 
ministered orally). Test booklet; manual, 58 pp.; 

keys class list. Philadelphia: Educa 
Test 

The Jastak Test represents a bold attempt to com 
bine in one measuring process indices of potential 
ability personality. Ten subtests, most of them 
familiar versions of items used other intelligence 
tests and with time limits ranging between 3 and 8 


and 
Bureau, 1958 


scoring 
tional 


and 


PR 


OGICAL 


Wiyvizws 


Each 
can be converted to a standard score 
to obtain a conventional intelligence 
maining 
the scatter of 


subtest 
and combined 
index. The re 


various aspects ol 


ninutes, provide the basic data score 


derived from 
Thus, 
which, by an incompletely dé 
uses the individual’s highest 
a basic for estimating his 
rom his current level of 
vidual 


scores are 


subtests there is a capacity 


core, cribed process 


subtest performance as 
capacity as distinguished 
func 


variance in the subtests is further 


tioning. The intra-indi 
utilized in 


various combinations to derive personality factor 
realit 

format is tractive and th 
designed to n 


balance 


identified as language, 
chomotor. The 


motivational, and psy 

items appear 

seems to be i good 

sampled 
Considering the fact that ad 

inual has sev 


techni est cde 


tors are invited to use this 
eral defects. Much of the 


aiscussion is too complex ) 


lopment 
have much meaning to 


this audience and is too brief for the technicalls 


trained reader. No 


the process of 


eferences to fuller descriptions of 
cited. Samples of 
norms, re 


analysis are adequate 
liability indices 


idies. The reli 


with only few 


size provide the basis for 
and intercorrelational and factor st 
abilities of the 
between .80 and 88. The 
tween the rang 
of the 


subtests, exceptions 


range intercorrelations be 


scores which form the basis for each 


four personality scores are disquietingly low 
Though the manual 
pitfalls in the administration of the test and the in 
terpretation of the 
about the 


evaluation of 


contains many warnings about 


results r ire no warnings 
experience and I ung ‘ to an 
a child’s cont other 
ymptoms of maladaption 

When one 


0 measure 


considers that thi istrument is claimed 


both intelligence and personality, it is sur 


bare ot 


} 


prising to find the 
tion data 
expe rience 
This is weak 


manual complete valida 
Reference is made to the 


and several case histories are 


iuthor’s clinical 
presente d 
against the 
efforts to 


evidence to marshal man 


discouraging results of other demonstrate 


in intelligence subtests as indices 
Not ey 


to predict school performance 


the value of scatter 


of personality en evidence of the test’s ability 


is offered. Its use for 


? 


5 
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this latter purpose probably can be supported on the 
basis of the precedence provided by other tests of 
similar content that have been demonstrated to have 
similar value. Without validation data, the Jastak 
Test cannot be accepted as a way of obtaining the 
other inferences it purports to provide—E. S. B 


Ford, J. S., Grimsley, G., Ruch, F. L., & Warren, 
N. D. Employee Aptitude Survey. College and 
adult. 2 forms. 55 min. 10 separate subtest book- 
lets, Form A or Form B ($2.50 per 25, $6.00 per 
100, and $25.00 per 500 for each subtest, includes 
manual and scoring stencils); a general manual, 
6 pp.; a manual, 4 pp., and scoring stencil. for 
each subtest; a manual for interpretation, 11 pp 
Los Angeles: Psychological Services, 1956 
With few exceptions the 10 subtests in this bat 

tery (verbal comprehension, numerical ability, visual 

pursuit, visual speed and accuracy, space visualiza 
tion, numerical reasoning, verbal reasoning, word 
fluency, manual speed and accuracy, and symbolic 
reasoning) are familiar versions of other tests. The 
relatively high reliabilities (range .7 to .8) obtained 
for such brief tests suggest a careful item analysis 

Because the items are incorporated into the answer 

sheet, the distribution of test materials can be ex 

pedited. 

There are several respects in which the manuals for 
these tests are lacking. In a few instances no data on 
the correlation between alternate 


forms is offered 


Test Reviews 


Information on the intercorrelation of the subtests is 
given in a form of coefficients of independence which 
conceal as much as they reveal. The unwary reader will 
overlook the fact that this coefficient [100 (1 — r*) ] 
not only reflects the variance specific to the test but 
also the variance due to errors of measurement. In 
the case of symbolic reasoning, its coefficient of in- 
dependence with respect to verbal reasoning is tabled 
as .64 for a sample of 90 high schol students. Work- 
ing backward, it becomes apparent that the correla- 
tion between the two tests is .60, a high degree of 
overlap when one considers that their respective test- 
retest reliabilities are .69 and .79. An intercorrelation 
table is a franker and more direct way to communi- 
cate the necessary information 
With the exception of word fluency, a considerable 
umount of impressive validation evidence is offered 
for each test. The reported multiple correlation of 
with one-year grade-point averages for a sample 
engineering students would be considered fan 
stic were it not topped by the report that a cross- 
ilidation of the regression equation in the next 
ur’s sample against a pass-fail criterion produced 
1 shrinkage of only .03. Unfortunately, no citations 
published studies are offered, and only very brief 
statements of validity studies are given 
If the validity studies cited are to be credited, th 
yee Aptitude Survey may be one of the most 
fficient test batteries we have for use with the wide 
nge of subjects represented by high school and col 
5. B 
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lege students, and by adult workers —E 
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BEATRICE A. WRIGHT, Ph.D. 
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Based on the proceedings of an Institute on the roles 
of psychology and psychologists in rehabilitation, 
sponsored by the American Psychological Association 
and supported by a grant from the Office of Voca 
tional Rehabilitation, Department of Health, Educa 
tion and Welfare. 


The volume examines the principles and assumptions 
underlying the modern philosophy of rehabilitation, 
paying special attention to the roles and functions of 
psychologists as members of an interdisciplinary team. 
Problems of training are explored in detail and in the 
context of the changing nature of the field. Areas of 
needed research are highlighted. 
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Outstanding McGRAW-HILL Zooks. . . 


CLINICAL PSYCHOLOGY — The Study of Persons 


By Ricnarp W. WALLEN, Creelman Associates. McGraw-Hill Series in Psychol- 
ogy. 400 pages, $6.50 


The major methods used by clinical psychologists are presented to help students prepare 
for actual practice. The treatment of the interview, projective methods, psychometric 
tests, and psychotherapy not only gives a survey of the clinician’s work, but establishes 
a foundation for further, specialized courses. Case material is given to help the student 
become more perceptive and more able to think like professional clinicians. An instruc 
tor’s manual is available for those using the text. 





NONPARAMETRIC STATISTICS: 
For the Behavioral Sciences 


By Sipney Srecer. Pennsylvania State University. 330 pages, $6.75. 


The first book-length treatment of nonparametric, or distribution-free statistics. It covers 
comprehensively the nonparametric statistical tests and measures of correlation, demon- 
strating their usefulness in behavioral science research. It is written for the reader with 
no special training in mathematics, and is organized to serve as a reference work and text. 


SCIENTIFIC METHOD IN PSYCHOLOGY 


By CLARENCE W. Brown and Epwin E. Guise ui, University of California, Berke 
ley. McGraw-Hill Series in Psychology. 380 pages, $6.50. 


his timely work describes the method of science as applied to the study of psychological 
phenomena. The text considers first the underlying logic of science as it relates to the 
study of human behavior, and then describes the commonly accepted steps used in con- 
ducting a scientific study of a psychological phenomenon. In the latter part of the book 
specific procedures and applications of the scientific methods in psychology are described. 


PERSONALITY 


By J. P. Gurtrorp, University of Southern California. McGraw-Hill Series in 
Psychology. 584 pages, $7.50 


A text for upper-division psychology and education students which places emphasis on 
individual differences, rather than on stimulus-response psychology of individual behav- 
ior. The approach is from the standpoint of the logic of experimental method. Many 
of the newer methods of personality assessment are described. The author develops a 
model of personality based upon factor theory as a basis for the assessment and descrip- 
tion of persons. Included are chapters describing personality in terms of dimensions 
found by factor analysis, including dimensions of morphology, physiology, aptitude, and 
pathology, as well as of temperament, needs, interests, and aptitudes. 


Send for copies on approval 


McGRAW-HILL BOOK CO., INC. 
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INTEGRATED EVALUATION 


THE KEY Q N in the: @eceptance of a student at Vevereux fs, 
“Wil; the child i yb being in our care?” A thorough, integrated 
evaluation _ seaee on question. 


First in is the detailed history reported by the referring 
physician. en the clinical stati at Devereux gives the student com- 
plete psychiatric, and medical evaluations. With the child 
assigned arily to a 5, home-school unit, this study covers his 
inter-person eae da ard his response to preliminary therapy. 


Upon the outcome of his integrated evaluation, which is reported to 
he parents and the referring agent, depends the final acceptance of the 
child and the program of therapy that lies ahead. 
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